00000001:02000400:3.0F:1790920206.957199:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_hostid 00000001:02000400:3.0:1790920227.257238:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1790920229.188127:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 615 MB/s 00000001:01000000:3.0:1790920229.441570:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 612 MB/s 00000001:01000000:1.0F:1790920229.690786:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6595 MB/s 00000020:02000000:1.0:1790920230.399394:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_63_g006d100 00000400:02000000:0.0:1790920231.188793:0:3288:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.134@tcp [8/256/0/180] 00008000:02000000:3.0:1790920235.315671:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1790920285.182547:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790920295.310225:0:5826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790920295.310231:0:5826:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1790920295.310385:0:5826:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000080e5ca22 00000080:02000400:3.0:1790920295.310399:0:5826:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1790920295.314893:0:5826:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1790920295.314908:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0F:1790920295.315178:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009a2a3716) 00000020:00000080:2.0:1790920295.315211:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790920295.331951:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790920295.332840:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790920295.356941:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790920295.356983:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790920295.357003:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790920295.357199:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790920295.357229:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790920295.357635:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790920295.357644:0:5826:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790920295.357656:0:5826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a49158445469da4 00000020:01000004:2.0:1790920295.357664:0:5826:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790920295.357669:0:5826:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790920295.357674:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000080e5ca22 from MGS 00000020:01000004:2.0:1790920295.357679:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790920295.357689:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dd9a7794) 00000020:00000080:2.0:1790920295.357700:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790920295.357785:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000080e5ca22 from MGS, refs=2 00080000:01000000:2.0:1790920295.357789:0:5826:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790920295.357807:0:5826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a49158445469db2 00000100:00100000:2.0:1790920295.357930:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790920295.358218:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790920295.358226:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790920295.359324:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790920295.359336:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790920295.360286:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920295.360492:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790920295.360497:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790920295.361360:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790920295.361369:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790920295.361894:0:5826:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790920295.361901:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790920295.362645:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920295.362648:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920295.362650:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920295.363445:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920295.363448:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920295.363450:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920295.363961:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790920295.370362:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790920295.617566:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4366 MB/s 00000001:01000000:2.0:1790920295.868021:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3119 MB/s 00000001:01000000:3.0:1790920296.118258:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 663 MB/s 00000001:01000000:2.0:1790920296.368008:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1503 MB/s 00080000:10000000:2.0:1790920296.373742:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1790920296.383628:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790920296.383647:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790920296.383651:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790920296.384483:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790920296.384841:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790920296.384888:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790920296.385076:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790920296.385098:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790920296.385551:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920296.385733:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790920296.385740:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790920296.386769:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790920296.386778:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790920296.387297:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790920296.387305:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790920296.393519:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:3.0:1790920296.393532:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1790920296.393545:0:5826:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.134@tcp' 00000020:01000004:2.0:1790920296.393547:0:5826:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790920296.393598:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.134@tcp (typ=mgc) 00000020:00000080:2.0:1790920296.393611:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.134@tcp (00000000b81f4e03) 00000020:00000080:2.0:1790920296.393628:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790920296.393718:0:5826:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a19f356b@MGC192.168.204.134@tcp: add connection 192.168.204.134@tcp at head 00010000:00010000:2.0:1790920296.393908:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.134@tcp-0 is initialized 00000040:01000000:2.0:1790920296.393916:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 1 is initialized 10000000:01000000:0.0:1790920296.394650:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790920296.394844:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.134@tcp (uuid c919bef2-7b4c-43c9-b63e-1d62f5af2ace) 00000020:00000080:2.0:1790920296.394862:0:5826:0:(genops.c:1384:class_connect()) connect: client c919bef2-7b4c-43c9-b63e-1d62f5af2ace, cookie 0x2a49158445469dc0 00000100:00080000:2.0:1790920296.394873:0:5826:0:(import.c:545:import_select_connection()) MGC192.168.204.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790920296.394883:0:5826:0:(import.c:666:import_select_connection()) MGC192.168.204.134@tcp: import 00000000a19f356b using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1790920296.394932:0:5826:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000067aa5e5d x1877915972141184/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790920296.394953:0:5826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS 00000020:01000004:2.0:1790920296.394971:0:5826:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790920296.394993:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790920296.395004:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000567af3a8) 00000020:00000080:2.0:1790920296.395014:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790920296.396465:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067aa5e5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3303:1877915972141184:0@lo:250: 00000100:00100000:1.0:1790920296.396540:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920296.398715:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972141184 00000100:00100000:0.0:1790920296.398734:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972141184 00000100:00100000:0.0:1790920296.398817:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920296.398825:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000063d27c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1877915972141184:12345-0@lo:250: 00010000:00080000:0.0:1790920296.398857:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c919bef2-7b4c-43c9-b63e-1d62f5af2ace@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:0.0:1790920296.398891:0:5837:0:(genops.c:1384:class_connect()) connect: client c919bef2-7b4c-43c9-b63e-1d62f5af2ace, cookie 0x2a49158445469dce 00000100:00080000:0.0:1790920296.399030:0:5837:0:(import.c:65:import_set_state_nolock()) 000000008f03419b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920296.399130:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000063d27c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:3303:x1877915972141184:12345-0@lo:250: Request processed in 305us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920296.399139:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920296.401356:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790920296.401375:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.134@tcp: connect to target with instance 0 00000100:00080000:1.0:1790920296.401387:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790920296.401394:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790920296.401398:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000a19f356b MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790920296.401416:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790920296.401430:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790920296.401440:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067aa5e5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3303:1877915972141184:0@lo:250: 00000100:00100000:0.0:1790920296.404733:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790920296.404992:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790920296.405000:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790920296.406477:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790920296.406488:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790920296.408836:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790920296.408849:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790920296.410230:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920296.410481:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790920296.410498:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790920296.413400:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790920296.413427:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:0.0:1790920296.428591:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920296.493024:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920296.493258:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790920296.493265:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790920296.495701:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790920296.495716:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790920296.496915:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920296.497315:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790920296.497322:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790920296.498617:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790920296.498635:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790920296.499325:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920296.504125:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790920296.504144:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790920296.504663:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790920296.504670:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790920296.505148:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920296.505338:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790920296.505344:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790920296.505970:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790920296.505979:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790920296.528091:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790920296.528350:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790920296.528357:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790920296.533650:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790920296.533675:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790920296.535293:0:5826:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790920296.535309:0:5826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790920296.536100:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790920296.536123:0:5826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790920296.536130:0:5826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790920296.536272:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790920296.536310:0:5826:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1790920296.536315:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790920296.536316:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920296.536318:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920296.536319:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920296.536321:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920296.536322:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920296.536324:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920296.536325:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920296.536327:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920296.536329:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920296.536331:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920296.536332:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920296.536335:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1790920296.536337:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790920296.536339:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920296.536340:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920296.536341:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920296.536348:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920296.536349:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920296.536350:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920296.536350:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920296.536351:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920296.536352:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920296.536353:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920296.536354:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920296.536391:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790920296.536420:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059a0eb54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141312:0@lo:253: 00000100:00100000:2.0:1790920296.536571:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920296.536635:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972141312 00000100:00100000:0.0:1790920296.536645:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972141312 00000100:00100000:2.0:1790920296.536648:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb1749e going to sleep for 11 seconds 00000100:00100000:0.0:1790920296.536696:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920296.536706:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e53e1100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:5826:x1877915972141312:12345-0@lo:253: 20000000:01000000:0.0:1790920296.536784:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790920296.536792:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1790920296.537030:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790920296.537125:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1790920296.537501:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790920296.538324:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790920296.538553:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790920296.538557:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790920296.538563:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790920296.538567:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790920296.538596:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790920296.538821:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920296.539076:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790920296.539089:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790920296.539143:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790920296.539195:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790920296.539232:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790920296.539320:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790920296.539328:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790920296.539374:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790920296.539382:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790920296.539863:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790920296.539875:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790920296.539919:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790920296.539973:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790920296.540014:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790920296.540020:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790920296.540034:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920296.540886:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1790920296.540900:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790920296.540941:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1790920296.540971:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1790920296.541046:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1790920296.541060:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1790920296.541147:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1790920296.541163:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790920296.541215:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1790920296.541252:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1790920296.541288:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1790920296.541300:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1790920296.541412:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1790920296.541423:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1790920296.542635:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1790920296.542683:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1790920296.542926:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1790920296.542976:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1790920296.542984:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1790920296.543840:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790920296.544522:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790920296.544550:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.134@tcp for mdt 20000000:01000000:3.0:1790920296.544552:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790920296.544610:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790920296.544618:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790920296.544650:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790920296.544657:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:3.0:1790920296.544703:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790920296.544713:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790920296.544787:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790920296.544827:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1790920296.544888:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790920296.544892:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790920296.544899:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1790920296.544907:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1790920296.546163:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1790920296.546275:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1790920296.559525:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1790920296.560089:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1790920296.560178:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1790920296.560201:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790920296.560204:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790920296.560207:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790920296.560222:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790920296.560225:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790920296.560260:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790920296.560262:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790920296.560682:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1790920296.561109:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1790920296.561150:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1790920296.561216:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1790920296.561230:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790920296.561232:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790920296.561535:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1790920296.561925:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790920296.561967:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790920296.562004:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1790920296.562018:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790920296.562020:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1790920296.562028:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790920296.562053:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562071:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562082:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562089:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562095:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562102:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562110:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009fdfe3fb already unused, calling callback (000000009dd011b6) 00010000:00010000:0.0:1790920296.562123:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562132:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562145:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562152:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.562158:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fdfe3fb/0x2a49158445469dd5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790920296.562175:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790920296.766964:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e53e1100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:5826:x1877915972141312:12345-0@lo:253: Request processed in 230252us (230384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920296.766980:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790920296.767151:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059a0eb54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141312:0@lo:253: 10000000:01000000:2.0:1790920296.767167:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790920296.767170:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790920296.767172:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920296.767173:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920296.767174:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1790920296.767176:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920296.767177:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920296.767178:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920296.767179:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920296.767181:0:5826:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790920296.767192:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920296.767194:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790920296.767213:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000080e5ca22 from lustre-MDT0000 10000000:01000000:2.0:1790920296.767238:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790920296.767240:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790920296.767245:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88eb05f10000 10000000:01000000:2.0:1790920296.767248:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790920296.767256:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88eb05f10000 from 1 10000000:01000000:2.0:1790920296.767258:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790920296.767301:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 0000000011fa7525/0x2a49158445469ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.767312:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 0000000011fa7525/0x2a49158445469ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.767320:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 0000000011fa7525/0x2a49158445469ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920296.767337:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059a0eb54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141440:0@lo:101: 00000100:00100000:2.0:1790920296.767373:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920296.767475:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd995b79 going to sleep for 11 seconds 00000100:00100000:0.0:1790920296.768001:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972141440 00000100:00100000:0.0:1790920296.768075:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972141440 00000100:00100000:0.0:1790920296.768128:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790920296.768136:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006491c4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:5826:x1877915972141440:12345-0@lo:101: 00010000:00010000:0.0:1790920296.768152:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920296.768170:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fdfe3fb/0x2a49158445469de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469ddc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.768195:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fdfe3fb/0x2a49158445469de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469ddc expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.768206:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fdfe3fb/0x2a49158445469de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469ddc expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920296.768225:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fdfe3fb, rc 0) 00000100:00100000:0.0:1790920296.768323:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006491c4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+6:5826:x1877915972141440:12345-0@lo:101: Request processed in 188us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920296.768330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920296.768449:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059a0eb54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141440:0@lo:101: 00010000:00010000:1.0:1790920296.768464:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 0000000011fa7525/0x2a49158445469ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920296.768473:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 0000000011fa7525/0x2a49158445469ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920296.768550:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000404a20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141568:0@lo:501: 00000100:00100000:1.0:1790920296.768579:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920296.768654:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 000000006d12e959 going to sleep for 11 seconds 00000100:00100000:0.0:1790920296.768693:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972141568 00000100:00100000:0.0:1790920296.768697:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972141568 00000100:00100000:0.0:1790920296.768784:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920296.768791:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007db12ed6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+6:5826:x1877915972141568:12345-0@lo:501: 00000100:00100000:0.0:1790920296.769001:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007db12ed6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+6:5826:x1877915972141568:12345-0@lo:501: Request processed in 212us (422us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790920296.769020:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790920296.769082:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000404a20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141568:0@lo:501: 10000000:01000000:2.0:1790920296.769121:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790920296.769145:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 0000000011fa7525/0x2a49158445469ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.769152:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 0000000011fa7525/0x2a49158445469ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920296.769160:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88eb09ba1000 10000000:01000000:2.0:1790920296.769166:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790920296.769177:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88eb09ba1000 10000000:01000000:2.0:1790920296.769180:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790920296.769183:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88eb09ba1000 from 1 10000000:01000000:2.0:1790920296.769186:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790920296.769207:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000005758a47c/0x2a49158445469dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.769215:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000005758a47c/0x2a49158445469dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.769223:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000005758a47c/0x2a49158445469dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920296.769234:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141696:0@lo:101: 00000100:00100000:2.0:1790920296.769263:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920296.769522:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d06ebb6b going to sleep for 11 seconds 00000100:00100000:1.0:1790920296.769605:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972141696 00000100:00100000:1.0:1790920296.769610:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972141696 00000100:00100000:1.0:1790920296.769646:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790920296.769652:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000046acfe05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+6:5826:x1877915972141696:12345-0@lo:101: 00010000:00010000:1.0:1790920296.769662:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920296.769674:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef4bb1c2/0x2a49158445469df1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469dea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920296.769690:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef4bb1c2/0x2a49158445469df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469dea expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920296.769700:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef4bb1c2/0x2a49158445469df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469dea expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920296.769707:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef4bb1c2, rc 0) 00000100:00100000:1.0:1790920296.769760:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000046acfe05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+7:5826:x1877915972141696:12345-0@lo:101: Request processed in 95us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920296.769766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920296.769875:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141696:0@lo:101: 00010000:00010000:2.0:1790920296.769887:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000005758a47c/0x2a49158445469dea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.769894:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000005758a47c/0x2a49158445469dea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920296.769906:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790920296.769919:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 000000005758a47c/0x2a49158445469dea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.769925:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 000000005758a47c/0x2a49158445469dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920296.769942:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790920296.769945:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790920296.769949:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88eb09ba1000 10000000:01000000:2.0:1790920296.769952:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790920296.769954:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790920296.769957:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790920296.769972:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000004391c8bf/0x2a49158445469df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.769978:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000004391c8bf/0x2a49158445469df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.769985:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000004391c8bf/0x2a49158445469df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920296.769997:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141824:0@lo:101: 00000100:00100000:2.0:1790920296.770037:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920296.770052:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d06ebb6b going to sleep for 11 seconds 00000100:00100000:1.0:1790920296.770160:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972141824 00000100:00100000:1.0:1790920296.770165:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972141824 00000100:00100000:1.0:1790920296.770181:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790920296.770185:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a97253c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+7:5826:x1877915972141824:12345-0@lo:101: 00010000:00010000:1.0:1790920296.770192:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920296.770199:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb640b68/0x2a49158445469dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469df8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920296.770212:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb640b68/0x2a49158445469dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469df8 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920296.770229:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb640b68/0x2a49158445469dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469df8 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920296.770236:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb640b68, rc 0) 00000100:00100000:1.0:1790920296.770271:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a97253c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+8:5826:x1877915972141824:12345-0@lo:101: Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920296.770277:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920296.770347:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141824:0@lo:101: 00010000:00010000:2.0:1790920296.770358:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000004391c8bf/0x2a49158445469df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920296.770363:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000004391c8bf/0x2a49158445469df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920296.770416:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141952:0@lo:501: 00000100:00100000:2.0:1790920296.770439:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920296.770463:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d06ebb6b going to sleep for 11 seconds 00000100:00100000:1.0:1790920296.770507:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972141952 00000100:00100000:1.0:1790920296.770511:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972141952 00000100:00100000:1.0:1790920296.770525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920296.770529:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d2151e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+8:5826:x1877915972141952:12345-0@lo:501: 00000100:00100000:1.0:1790920296.770741:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d2151e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5826:x1877915972141952:12345-0@lo:501: Request processed in 210us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920296.770763:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790920296.770831:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972141952:0@lo:501: 00000100:00100000:2.0:1790920296.770856:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142080:0@lo:503: 00000100:00100000:2.0:1790920296.770889:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920296.770914:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d06ebb6b going to sleep for 11 seconds 00000100:00100000:1.0:1790920296.770960:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142080 00000100:00100000:1.0:1790920296.770964:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142080 00000100:00100000:1.0:1790920296.770980:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920296.770985:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c869001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5826:x1877915972142080:12345-0@lo:503: 00000100:00100000:1.0:1790920296.771146:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c869001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5826:x1877915972142080:12345-0@lo:503: Request processed in 160us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920296.771152:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790920296.771294:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142080:0@lo:503: 00000100:00100000:1.0:1790920296.771780:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e00c8e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5869:1877915972142208:0@lo:502: 00000100:00100000:1.0:1790920296.771821:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920296.771853:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae96cc42 going to sleep for 11 seconds 00000100:00100000:2.0:1790920296.771910:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142208 00000100:00100000:2.0:1790920296.771914:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142208 00000100:00100000:2.0:1790920296.771937:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790920296.771943:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ce180df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5869:x1877915972142208:12345-0@lo:502: 00000100:00100000:2.0:1790920296.772133:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ce180df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5869:x1877915972142208:12345-0@lo:502: Request processed in 190us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920296.772141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790920296.772277:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e00c8e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5869:1877915972142208:0@lo:502: 00000020:01000000:1.0:1790920296.772300:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920296.772316:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920296.772319:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790920296.772329:0:5869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790920296.772331:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790920296.772352:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c2dfa4d3) 00000020:00000080:1.0:1790920296.772372:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790920296.772379:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790920296.772473:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790920296.772482:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a49158445469e0d 00000020:00000080:1.0:1790920296.772706:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790920296.772710:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920296.772713:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920296.772714:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790920296.772716:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920296.772719:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920296.772721:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790920296.772723:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790920296.772729:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000061daf9d) 00000020:00000080:1.0:1790920296.772740:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790920296.772744:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790920296.772819:0:5869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790920296.772822:0:5869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790920296.772830:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790920296.772880:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000080e5ca22 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790920296.772892:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007db83b9c) 00000020:00000080:1.0:1790920296.772899:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790920296.772944:0:5869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790920296.772950:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a49158445469e22 00000020:00000080:1.0:1790920296.773166:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790920296.773173:0:5869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790920296.773177:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2a49158445469e29 00080000:01000000:1.0:1790920296.773182:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790920296.773185:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a49158445469e30 00080000:10000000:1.0:1790920296.773637:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1790920296.774030:0:5869:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1790920296.785340:0:5869:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790920296.849129:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1790920296.849527:0:5869:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1790920296.854264:0:5869:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1790920296.854590:0:5869:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790920296.930818:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000042f6d552) 00000020:00000080:0.0:1790920296.930848:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790920296.930988:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790920296.930996:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a49158445469e3e 00000020:00000080:0.0:1790920296.939192:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1790920296.946732:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920296.994629:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920297.032310:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920297.068505:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920297.107652:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920297.142556:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790920297.177601:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2a49158445469e45 00000020:00000080:1.0:1790920297.178119:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790920297.178135:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920297.178141:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920297.178144:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790920297.178147:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920297.178153:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920297.178154:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790920297.178159:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790920297.178199:0:5869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790920297.178213:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920297.178216:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920297.178217:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790920297.178220:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920297.178222:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920297.178223:0:5869:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790920297.178226:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790920297.178227:0:5869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790920297.178275:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e00c8e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5869:1877915972142336:0@lo:502: 00000100:00100000:1.0:1790920297.178362:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920297.178428:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d58b2379 going to sleep for 11 seconds 00000100:00100000:1.0:1790920297.178454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142336 00000100:00100000:1.0:1790920297.178461:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142336 00000100:00100000:1.0:1790920297.178501:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790920297.178510:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c1391c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5869:x1877915972142336:12345-0@lo:502: 00000100:00100000:1.0:1790920297.178914:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c1391c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5869:x1877915972142336:12345-0@lo:502: Request processed in 404us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920297.178922:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790920297.178979:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e00c8e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5869:1877915972142336:0@lo:502: 00000020:01000000:1.0:1790920297.179003:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920297.179013:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920297.179014:0:5869:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790920297.179018:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1790920297.179365:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1790920297.179397:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790920297.179415:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 000000004391c8bf/0x2a49158445469df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.179425:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 000000004391c8bf/0x2a49158445469df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920297.179438:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb09ba1000 from 1 10000000:01000000:2.0:1790920297.179441:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790920297.179468:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.179475:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.179483:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920297.179496:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142464:0@lo:101: 00000100:00100000:2.0:1790920297.179530:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.179636:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d35bffd0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920297.179971:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142464 00000100:00100000:0.0:1790920297.179977:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142464 00000100:00100000:0.0:1790920297.180095:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790920297.180103:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019851e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:5826:x1877915972142464:12345-0@lo:101: 00010000:00010000:0.0:1790920297.180115:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920297.180128:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469e4c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.180159:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469e4c expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.180167:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e4c expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.180175:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cfe79297, rc 0) 00000100:00100000:0.0:1790920297.180216:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019851e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:5826:x1877915972142464:12345-0@lo:101: Request processed in 114us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920297.180221:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790920297.180287:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142464:0@lo:101: 00010000:00010000:2.0:1790920297.180299:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.180307:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920297.180875:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142592:0@lo:256: 00000100:00100000:2.0:1790920297.180917:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.181195:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d35bffd0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920297.181275:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142592 00000100:00100000:1.0:1790920297.181281:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142592 00000100:00100000:1.0:1790920297.181304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790920297.181308:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bfe9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:5826:x1877915972142592:12345-0@lo:256: 20000000:01000000:1.0:1790920297.181323:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790920297.181328:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790920297.181409:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bfe9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:5826:x1877915972142592:12345-0@lo:256: Request processed in 100us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920297.181415:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790920297.181493:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142592:0@lo:256: 10000000:01000000:2.0:1790920297.182115:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790920297.182130:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.182149:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920297.182157:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb09ba1000 from 1 10000000:01000000:2.0:1790920297.182160:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790920297.182185:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.182192:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.182201:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920297.182215:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142720:0@lo:101: 00000100:00100000:2.0:1790920297.182248:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.182262:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d35bffd0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920297.182451:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142720 00000100:00100000:1.0:1790920297.182455:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142720 00000100:00100000:1.0:1790920297.182478:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790920297.182484:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016b80732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:5826:x1877915972142720:12345-0@lo:101: 00010000:00010000:1.0:1790920297.182493:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920297.182505:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469e5a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920297.182522:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469e5a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920297.182530:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e5a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920297.182537:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d40a379c, rc 0) 00000100:00100000:1.0:1790920297.182565:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016b80732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5826:x1877915972142720:12345-0@lo:101: Request processed in 82us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920297.182571:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790920297.182691:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142720:0@lo:101: 00010000:00010000:2.0:1790920297.182703:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.182710:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920297.182864:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142848:0@lo:501: 00000100:00100000:2.0:1790920297.182890:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.182915:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d35bffd0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920297.182962:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142848 00000100:00100000:1.0:1790920297.182967:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142848 00000100:00100000:1.0:1790920297.182994:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790920297.183096:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b88a24e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5826:x1877915972142848:12345-0@lo:501: 00000100:00100000:1.0:1790920297.183679:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b88a24e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5826:x1877915972142848:12345-0@lo:501: Request processed in 679us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920297.183687:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790920297.183914:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142848:0@lo:501: 00000100:00100000:2.0:1790920297.183949:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142976:0@lo:503: 00000100:00100000:2.0:1790920297.183990:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.184120:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d35bffd0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920297.184192:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972142976 00000100:00100000:3.0:1790920297.184199:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972142976 00000100:00100000:0.0:1790920297.184285:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790920297.184293:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c993153 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5826:x1877915972142976:12345-0@lo:503: 00000040:00080000:0.0:1790920297.184331:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790920297.184378:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c993153 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5826:x1877915972142976:12345-0@lo:503: Request processed in 87us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920297.184385:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920297.184469:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972142976:0@lo:503: 00000040:00080000:1.0:1790920297.185408:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790920297.186074:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790920297.186104:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790920297.186153:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.186165:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920297.186267:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790920297.186270:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88eb09ba1000 10000000:01000000:3.0:1790920297.186274:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88eb09ba1000 10000000:01000000:3.0:1790920297.186277:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790920297.186283:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb09ba1000 from 1 10000000:01000000:3.0:1790920297.186285:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790920297.186332:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000003e3c6ef9/0x2a49158445469e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920297.186340:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000003e3c6ef9/0x2a49158445469e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920297.186349:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000003e3c6ef9/0x2a49158445469e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920297.186365:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e86e4371 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143104:0@lo:101: 00000100:00100000:3.0:1790920297.186450:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920297.186486:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040ccc499 going to sleep for 11 seconds 00000100:00100000:0.0:1790920297.186545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972143104 00000100:00100000:0.0:1790920297.186552:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972143104 00000100:00100000:0.0:1790920297.186591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790920297.186597:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5826:x1877915972143104:12345-0@lo:101: 00010000:00010000:0.0:1790920297.186608:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920297.186620:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab909cc1/0x2a49158445469e6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469e68 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.186639:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab909cc1/0x2a49158445469e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469e68 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.186658:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab909cc1/0x2a49158445469e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e68 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.186666:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab909cc1, rc 0) 00000100:00100000:0.0:1790920297.186705:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5826:x1877915972143104:12345-0@lo:101: Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920297.186711:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790920297.186802:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e86e4371 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143104:0@lo:101: 00010000:00010000:2.0:1790920297.186814:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000003e3c6ef9/0x2a49158445469e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.186821:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000003e3c6ef9/0x2a49158445469e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920297.186863:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143232:0@lo:501: 00000100:00100000:2.0:1790920297.186886:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.186911:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb1749e going to sleep for 11 seconds 00000100:00100000:0.0:1790920297.187026:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972143232 00000100:00100000:0.0:1790920297.187031:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972143232 00000100:00100000:0.0:1790920297.187061:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790920297.187067:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7dd7842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5826:x1877915972143232:12345-0@lo:501: 00000100:00100000:0.0:1790920297.187306:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7dd7842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5826:x1877915972143232:12345-0@lo:501: Request processed in 239us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920297.187312:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790920297.187448:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143232:0@lo:501: 00000100:00100000:2.0:1790920297.187473:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143360:0@lo:503: 00000100:00100000:2.0:1790920297.187509:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.187538:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb1749e going to sleep for 11 seconds 00000100:00100000:2.0:1790920297.187552:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972143360 00000100:00100000:2.0:1790920297.187556:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972143360 00000100:00100000:2.0:1790920297.187574:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790920297.187579:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024de7137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5826:x1877915972143360:12345-0@lo:503: 00000100:00100000:2.0:1790920297.187878:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024de7137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5826:x1877915972143360:12345-0@lo:503: Request processed in 299us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920297.187884:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790920297.187919:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143360:0@lo:503: 00000100:00100000:3.0:1790920297.188605:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a75ac4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5874:1877915972143488:0@lo:502: 00000100:00100000:3.0:1790920297.188650:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920297.188716:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000396872c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920297.188965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972143488 00000100:00100000:2.0:1790920297.188970:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972143488 00000100:00100000:3.0:1790920297.189179:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790920297.189187:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc0e02f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5874:x1877915972143488:12345-0@lo:502: 00000100:00100000:3.0:1790920297.189448:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc0e02f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5874:x1877915972143488:12345-0@lo:502: Request processed in 261us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920297.189456:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790920297.189532:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a75ac4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5874:1877915972143488:0@lo:502: 00000020:01000004:1.0:1790920297.189592:0:5874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790920297.189605:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009a4df97d) 00000020:00000080:1.0:1790920297.189623:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790920297.189703:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000080e5ca22 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790920297.189708:0:5874:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000080e5ca22 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790920297.189710:0:5874:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000080e5ca22 4 00010000:00080000:1.0:1790920297.189738:0:5874:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c03a0cd7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1790920297.191412:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1790920297.191616:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790920297.191646:0:5874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790920297.191656:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2a49158445469e7d 00000100:00080000:1.0:1790920297.191665:0:5874:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790920297.191674:0:5874:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c03a0cd7 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1790920297.191705:0:5874:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006e00c8e2 x1877915972143616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790920297.191783:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e00c8e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972143616:0@lo:38: 00000100:00100000:1.0:1790920297.191841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790920297.191895:0:5874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790920297.193439:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972143616 00000100:00100000:0.0:1790920297.193455:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972143616 00000100:00100000:0.0:1790920297.193504:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920297.193512:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e148d546 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1877915972143616:12345-0@lo:38: 00000100:00100000:0.0:1790920297.193812:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e148d546 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1877915972143616:12345-0@lo:38: Request processed in 299us (1969us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790920297.193820:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920297.193875:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790920297.193884:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000c03a0cd7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790920297.193889:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790920297.193892:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e00c8e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972143616:0@lo:38: 00000100:00100000:0.0:1790920297.195098:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f950694 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5874:1877915972143744:0@lo:502: 00000100:00100000:0.0:1790920297.195171:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920297.195208:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972143744 00000100:00100000:0.0:1790920297.195214:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972143744 00000100:00100000:0.0:1790920297.195249:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790920297.195257:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d40d5a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5874:x1877915972143744:12345-0@lo:502: 00000100:00100000:0.0:1790920297.195500:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d40d5a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5874:x1877915972143744:12345-0@lo:502: Request processed in 244us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920297.195508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790920297.195558:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000201b27ff going to sleep for 11 seconds 00000100:00100000:0.0:1790920297.195576:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f950694 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5874:1877915972143744:0@lo:502: 00000040:00080000:0.0:1790920297.195602:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1790920297.196142:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790920297.196172:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790920297.196198:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 000000003e3c6ef9/0x2a49158445469e68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920297.196210:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 000000003e3c6ef9/0x2a49158445469e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790920297.196261:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790920297.196264:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920297.196265:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920297.196267:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920297.196268:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920297.196270:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920297.196271:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920297.196272:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920297.196274:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920297.196275:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920297.196276:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920297.196278:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790920297.196281:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1790920297.196283:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790920297.196290:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920297.196291:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920297.196292:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920297.196293:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920297.196294:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920297.196294:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920297.196295:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920297.196296:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920297.196297:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920297.196298:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920297.196299:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790920297.196316:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790920297.196326:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143872:0@lo:253: 00000100:00100000:2.0:1790920297.196368:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920297.196470:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb1749e going to sleep for 11 seconds 00000100:00100000:3.0:1790920297.197761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972143872 00000100:00100000:3.0:1790920297.197788:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972143872 00000100:00100000:3.0:1790920297.197843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790920297.197850:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077cc2107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5826:x1877915972143872:12345-0@lo:253: 20000000:01000000:3.0:1790920297.197877:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790920297.197890:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790920297.226270:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790920297.226282:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790920297.226341:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790920297.226346:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790920297.226368:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.226399:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e4c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.226407:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.226450:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469e4c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.226465:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469e4c expref: 12 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920297.226481:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f950694 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877915972144000:0@lo:104: 00000100:00100000:0.0:1790920297.226569:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920297.226622:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000201b27ff going to sleep for 11 seconds 00000100:00100000:0.0:1790920297.226652:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144000 00000100:00100000:0.0:1790920297.226660:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144000 00000100:00100000:0.0:1790920297.226708:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920297.226717:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000981c49f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5861:x1877915972144000:12345-0@lo:104: 00010000:00010000:0.0:1790920297.226730:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.227660:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790920297.227669:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000981c49f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5861:x1877915972144000:12345-0@lo:104: Request processed in 953us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920297.227678:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920297.227726:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f950694 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877915972144000:0@lo:104: 00010000:00010000:0.0:1790920297.228317:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228339:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920297.228346:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228354:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7a74388 already unused, calling callback (0000000038b19590) 10000000:00010000:0.0:1790920297.228358:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228367:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920297.228374:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920297.228402:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790920297.228447:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228455:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920297.228473:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228480:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: 00000000c7a74388/0x2a49158445469e4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e53 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228498:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920297.228500:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920297.228502:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920297.228561:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f950694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972144128:0@lo:103: 00000100:00100000:0.0:1790920297.228603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920297.228657:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144128 00000100:00100000:0.0:1790920297.228663:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144128 00010000:00010000:0.0:1790920297.228686:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e4c expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920297.228711:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920297.228717:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd58436e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:3305:x1877915972144128:12345-0@lo:103: 00010000:00010000:0.0:1790920297.228728:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920297.228732:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e4c expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228741:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469e4c expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228784:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cfe79297/0x2a49158445469e53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469e4c expref: 13 pid: 5839 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228796:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228802:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790920297.228815:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002469508s 00010000:00010000:0.0:1790920297.228819:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228824:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228829:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228834:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228839:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006857cc43 already unused, calling callback (000000009dd011b6) 00010000:00010000:0.0:1790920297.228842:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228847:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228857:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228873:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920297.228900:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd58436e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3305:x1877915972144128:12345-0@lo:103: Request processed in 183us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920297.228906:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790920297.228929:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228937:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920297.228943:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006857cc43/0x2a49158445469e84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920297.228971:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f950694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972144128:0@lo:103: 00000100:00100000:3.0:1790920297.238943:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077cc2107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5826:x1877915972143872:12345-0@lo:253: Request processed in 41085us (42566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920297.238960:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790920297.239127:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5826:1877915972143872:0@lo:253: 10000000:01000000:2.0:1790920297.239143:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790920297.239147:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790920297.239149:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920297.239150:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920297.239152:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920297.239153:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920297.239154:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920297.239155:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920297.239157:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920297.239159:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920297.239160:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920297.239162:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920297.239163:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790920297.239180:0:5826:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790920297.244043:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920297.244447:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790920297.244704:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920297.245301:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790920297.245532:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920297.245684:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790920297.246997:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920297.247235:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790920297.247427:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920297.247625:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790920297.247922:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920297.248184:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1790920297.287109:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1790920297.317486:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1790920297.317886:0:5880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1790920297.325393:0:5879:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790920297.325401:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790920297.325989:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790920297.326302:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790920297.326710:0:5826:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790920297.326717:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790920297.326850:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790920297.327804:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790920297.328314:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790920297.328343:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790920297.331869:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790920297.332214:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1790920297.334705:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790920297.335071:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1790920297.335234:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790920297.338192:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790920297.338671:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790920297.338877:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790920297.339047:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790920297.339168:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790920297.339312:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790920297.339619:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790920297.339852:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790920297.339992:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790920297.340208:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790920297.340535:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790920297.340688:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790920297.341646:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790920297.342090:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790920297.342230:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790920297.342367:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790920297.342968:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790920297.343145:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790920297.343285:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790920297.343547:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1790920297.343664:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1790920297.343835:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1790920297.343968:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1790920297.344161:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1790920297.344311:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1790920297.344483:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1790920297.344610:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790920297.344734:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790920297.344896:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790920297.345095:0:5826:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1790920297.368452:0:5880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1790920297.436920:0:5826:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790920297.436967:0:5826:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaea801c93988 00100000:10000000:3.0:1790920297.436977:0:5826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790920297.439394:0:5826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790920297.439414:0:5826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790920297.439428:0:5826:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790920297.439463:0:5826:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1790920297.453819:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790920297.480737:0:5880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790920297.481105:0:5880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790920297.481110:0:5880:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1790920298.475917:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920299.497354:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920300.522037:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920301.544867:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920302.569484:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920302.700863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790920302.700875:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790920302.700879:0:37:0:(import.c:65:import_set_state_nolock()) 00000000c03a0cd7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790920302.700898:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c03a0cd7 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1790920302.700924:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001dd46f6e x1877915972144384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790920302.702449:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001dd46f6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972144384:0@lo:38: 00000100:00100000:0.0:1790920302.702533:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920302.702614:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144384 00000100:00100000:0.0:1790920302.702623:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144384 00000100:00100000:0.0:1790920302.702660:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920302.702667:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f950694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877915972144384:12345-0@lo:38: 00010000:00080000:0.0:1790920302.702697:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:0.0:1790920302.702736:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2a49158445469e8b 00000004:00100000:0.0:1790920302.702799:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790920302.702930:0:5847:0:(import.c:65:import_set_state_nolock()) 00000000118934c0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920302.702988:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f950694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877915972144384:12345-0@lo:38: Request processed in 319us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920302.702995:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790920302.703038:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001dd46f6e x1877915972144384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790920312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790920302.703055:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790920302.703062:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790920302.703066:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790920302.703069:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000c03a0cd7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790920302.703074:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001dd46f6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972144384:0@lo:38: 00000100:00100000:3.0:1790920302.709115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae616467 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972144256:0@lo:400: 00000100:00100000:3.0:1790920302.709197:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920302.709651:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144256 00000100:00100000:2.0:1790920302.709662:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144256 00000100:00100000:2.0:1790920302.709721:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790920302.709731:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000173e889b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:3306:x1877915972144256:12345-0@lo:400: 00000100:00100000:2.0:1790920302.709820:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000173e889b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:3306:x1877915972144256:12345-0@lo:400: Request processed in 91us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920302.709828:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790920302.713171:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae616467 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972144256:0@lo:400: 00000001:02000400:3.0:1790920302.828299:0:6123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790920303.598042:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920304.617408:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920305.642568:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920306.669681:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790920306.792994:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790920306.793005:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb09ba1000 from 3 10000000:01000000:1.0:1790920306.793010:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790920306.793557:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 0000000062391d63/0x2a49158445469e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920306.793571:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 0000000062391d63/0x2a49158445469e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920306.793583:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 0000000062391d63/0x2a49158445469e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920306.793607:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058544700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972144512:0@lo:101: 00000100:00100000:1.0:1790920306.793684:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920306.796217:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144512 00000100:00100000:3.0:1790920306.796234:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144512 00000100:00100000:3.0:1790920306.796306:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920306.796318:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbaf21c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5842:x1877915972144512:12345-0@lo:101: 00010000:00010000:3.0:1790920306.796338:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920306.796363:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a73376b0/0x2a49158445469e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469e92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920306.796391:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a73376b0/0x2a49158445469e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469e92 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920306.796402:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a73376b0/0x2a49158445469e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e92 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920306.796412:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a73376b0, rc 0) 00000100:00100000:3.0:1790920306.796689:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbaf21c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972144512:12345-0@lo:101: Request processed in 373us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920306.796697:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790920306.798618:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe0fe051 going to sleep for 11 seconds 00000100:00100000:0.0:1790920306.798665:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058544700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972144512:0@lo:101: 00010000:00010000:0.0:1790920306.798691:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 0000000062391d63/0x2a49158445469e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920306.798704:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 0000000062391d63/0x2a49158445469e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920306.798810:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2bd08a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972144640:0@lo:256: 00000100:00100000:0.0:1790920306.800522:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920306.800579:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7d96664 going to sleep for 11 seconds 00000100:00100000:2.0:1790920306.802133:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144640 00000100:00100000:2.0:1790920306.802151:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144640 00000100:00100000:2.0:1790920306.802227:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790920306.802238:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c419a827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972144640:12345-0@lo:256: 20000000:01000000:2.0:1790920306.802265:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790920306.802283:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790920306.802286:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790920306.803891:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c419a827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972144640:12345-0@lo:256: Request processed in 1650us (3365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920306.803904:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790920306.804966:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2bd08a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972144640:0@lo:256: 10000000:01000000:0.0:1790920306.805025:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790920306.805034:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 0000000062391d63/0x2a49158445469e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920306.805046:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 0000000062391d63/0x2a49158445469e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920307.714271:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920307.820742:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053aa36e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972144896:0@lo:400: 00000100:00100000:2.0:1790920307.820866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920307.820991:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144896 00000100:00100000:2.0:1790920307.821000:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144896 00000100:00100000:2.0:1790920307.821049:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920307.821057:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca6cdad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972144896:12345-0@lo:400: 00000100:00100000:2.0:1790920307.821133:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca6cdad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972144896:12345-0@lo:400: Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920307.821141:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790920307.821197:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000053aa36e8 x1877915972144896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920307.821212:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053aa36e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972144896:0@lo:400: 00000100:00100000:3.0:1790920307.821569:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972144768:0@lo:400: 00000100:00100000:3.0:1790920307.821607:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920307.823718:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972144768 00000100:00100000:2.0:1790920307.823736:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972144768 00000100:00100000:2.0:1790920307.823825:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790920307.823835:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5aa446d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3307:x1877915972144768:12345-0@lo:400: 00000100:00100000:2.0:1790920307.823945:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5aa446d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3307:x1877915972144768:12345-0@lo:400: Request processed in 112us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920307.823954:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790920307.824129:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064ebe08a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972144768:0@lo:400: 00000020:00000080:1.0:1790920308.152469:0:6325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6c8490f0 20000000:00000080:1.0:1790920308.152488:0:6325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88eb071b0000 uarg=0000000000000000 20000000:01000000:1.0:1790920308.152527:0:6325:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790920308.152535:0:6325:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790920308.152541:0:6325:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790920308.152798:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790920308.152814:0:6325:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790920308.161908:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790920308.162230:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790920308.162287:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1790920308.162538:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1790920308.162558:0:6325:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790920308.162579:0:6325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.162599:0:6325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e5a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.162606:0:6325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.162647:0:6325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469e5a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.162662:0:6325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469e5a expref: 11 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920308.162689:0:6325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074a26105 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1877915972145024:0@lo:104: 00000100:00100000:1.0:1790920308.162996:0:6325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920308.163116:0:6325:0:(client.c:2716:ptlrpc_set_wait()) set 00000000967add81 going to sleep for 11 seconds 00000100:00100000:0.0:1790920308.163154:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145024 00000100:00100000:0.0:1790920308.163164:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145024 00000100:00100000:0.0:1790920308.163252:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920308.163261:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d6774e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:6325:x1877915972145024:12345-0@lo:104: 00010000:00010000:0.0:1790920308.163276:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920308.163347:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790920308.163362:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d6774e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:6325:x1877915972145024:12345-0@lo:104: Request processed in 103us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920308.163370:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920308.163548:0:6325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074a26105 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1877915972145024:0@lo:104: 00010000:00010000:1.0:1790920308.163576:0:6325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920308.163632:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920308.163639:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920308.163646:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f174524d already unused, calling callback (0000000038b19590) 10000000:00010000:3.0:1790920308.163649:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920308.163667:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790920308.164079:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920308.164086:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790920308.164117:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920308.164125:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790920308.164173:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038d8d5fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972145152:0@lo:103: 00000100:00100000:2.0:1790920308.164227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920308.164311:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145152 00000100:00100000:1.0:1790920308.164316:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145152 00010000:00010000:1.0:1790920308.164338:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e5a expref: 12 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920308.164362:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920308.164368:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053aa36e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3305:x1877915972145152:12345-0@lo:103: 00010000:00010000:1.0:1790920308.164379:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920308.164384:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e5a expref: 12 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164393:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469e5a expref: 12 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164406:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d40a379c/0x2a49158445469e61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469e5a expref: 12 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164420:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164428:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164441:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164449:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164466:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164472:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164477:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ca119aa3 already unused, calling callback (000000009dd011b6) 00010000:00010000:1.0:1790920308.164480:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164487:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164500:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920308.164509:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920308.164557:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920308.164565:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: 00000000f174524d/0x2a49158445469e5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e61 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920308.164581:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920308.164583:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920308.164584:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920308.166840:0:6325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920308.166860:0:6325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920308.166866:0:6325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca119aa3/0x2a49158445469ea0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920308.168703:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053aa36e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:3305:x1877915972145152:12345-0@lo:103: Request processed in 4328us (4468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920308.168731:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790920308.169872:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038d8d5fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972145152:0@lo:103: 00010000:00010000:2.0:1790920308.777019:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920309.806061:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920310.826464:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920311.849610:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920312.885862:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920312.941372:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074a26105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972145280:0@lo:400: 00000100:00100000:1.0:1790920312.941466:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920312.941541:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920312.941547:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005529e4d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972145408:0@lo:400: 00000100:00100000:1.0:1790920312.941586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920312.941632:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145280 00000100:00100000:1.0:1790920312.941641:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145280 00000100:00100000:1.0:1790920312.941698:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790920312.941706:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c591f142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:3306:x1877915972145280:12345-0@lo:400: 00000100:00100000:1.0:1790920312.941797:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c591f142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:3306:x1877915972145280:12345-0@lo:400: Request processed in 92us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920312.941806:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790920312.941865:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074a26105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972145280:0@lo:400: 00000100:00100000:1.0:1790920312.948020:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145408 00000100:00100000:1.0:1790920312.948040:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145408 00000100:00100000:1.0:1790920312.948118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920312.948127:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078d6a1f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972145408:12345-0@lo:400: 00000100:00100000:1.0:1790920312.948248:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078d6a1f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972145408:12345-0@lo:400: Request processed in 123us (6668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920312.948256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790920312.948312:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005529e4d5 x1877915972145408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920312.948330:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005529e4d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972145408:0@lo:400: 00010000:00010000:2.0:1790920313.896985:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790920314.472841:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790920314.472853:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb09ba1000 from 1 10000000:01000000:0.0:1790920314.472859:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920314.472919:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000009022aefa/0x2a49158445469ea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920314.472934:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000009022aefa/0x2a49158445469ea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920314.472948:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000009022aefa/0x2a49158445469ea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920314.472978:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2bd08a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972145536:0@lo:101: 00000100:00100000:0.0:1790920314.473081:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920314.473144:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000003db8076f going to sleep for 11 seconds 00000100:00100000:3.0:1790920314.476027:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145536 00000100:00100000:3.0:1790920314.476047:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145536 00000100:00100000:3.0:1790920314.477139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790920314.477154:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b04e3a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:5842:x1877915972145536:12345-0@lo:101: 00010000:00010000:3.0:1790920314.477177:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920314.477208:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8722666/0x2a49158445469eae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469ea7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920314.477242:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8722666/0x2a49158445469eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469ea7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920314.477255:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8722666/0x2a49158445469eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469ea7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920314.477265:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8722666, rc 0) 00000100:00100000:3.0:1790920314.477365:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b04e3a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972145536:12345-0@lo:101: Request processed in 215us (4285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920314.477372:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790920314.477421:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2bd08a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972145536:0@lo:101: 00010000:00010000:2.0:1790920314.477446:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000009022aefa/0x2a49158445469ea7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920314.477456:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000009022aefa/0x2a49158445469ea7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920314.477537:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b9eea70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972145664:0@lo:501: 00000100:00100000:2.0:1790920314.477585:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920314.480891:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085f3cc90 going to sleep for 11 seconds 00000100:00100000:0.0:1790920314.486004:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145664 00000100:00100000:0.0:1790920314.486025:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145664 00000100:00100000:0.0:1790920314.486223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790920314.486235:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f638984a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972145664:12345-0@lo:501: 00000100:00100000:0.0:1790920314.486641:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f638984a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972145664:12345-0@lo:501: Request processed in 407us (9054us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920314.486648:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790920314.486806:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b9eea70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972145664:0@lo:501: 00000100:00100000:2.0:1790920314.486872:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b9eea70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972145792:0@lo:503: 00000100:00100000:2.0:1790920314.486925:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920314.486967:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085f3cc90 going to sleep for 11 seconds 00000100:00100000:2.0:1790920314.486982:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145792 00000100:00100000:2.0:1790920314.486987:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145792 00000100:00100000:2.0:1790920314.487012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790920314.487019:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a08d411d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972145792:12345-0@lo:503: 00000100:00100000:2.0:1790920314.487228:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a08d411d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972145792:12345-0@lo:503: Request processed in 209us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920314.487236:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790920314.487279:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b9eea70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972145792:0@lo:503: 00000100:00100000:2.0:1790920314.487515:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b9eea70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6668:1877915972145920:0@lo:502: 00000100:00100000:2.0:1790920314.487550:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920314.487572:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972145920 00000100:00100000:2.0:1790920314.487576:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972145920 00000100:00100000:2.0:1790920314.487597:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790920314.487603:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065983b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6668:x1877915972145920:12345-0@lo:502: 00000100:00100000:2.0:1790920314.487739:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065983b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6668:x1877915972145920:12345-0@lo:502: Request processed in 137us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920314.487773:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790920314.487809:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041731b4b going to sleep for 11 seconds 00000100:00100000:2.0:1790920314.487822:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b9eea70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6668:1877915972145920:0@lo:502: 00000020:01000000:2.0:1790920314.487856:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790920314.487868:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920314.487871:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790920314.487883:0:6668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb09ba1000 00000020:00000080:2.0:1790920314.487886:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790920314.487933:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6668:1877915972146048:0@lo:502: 00000100:00100000:2.0:1790920314.487971:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920314.487992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146048 00000100:00100000:2.0:1790920314.487996:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146048 00000100:00100000:2.0:1790920314.488016:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790920314.488022:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6668:x1877915972146048:12345-0@lo:502: 00000100:00100000:2.0:1790920314.488150:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6668:x1877915972146048:12345-0@lo:502: Request processed in 127us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920314.488157:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790920314.488189:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb20b70e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920314.488201:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6668:1877915972146048:0@lo:502: 00000020:01000000:2.0:1790920314.488220:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920314.488224:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920314.488226:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790920314.488230:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790920314.488288:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790920314.488309:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790920314.488321:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920314.488333:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920314.923461:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790920315.167978:0:6684:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790920315.167988:0:6684:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790920315.168192:0:6684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88eb05888000 00000020:01000004:2.0:1790920315.168257:0:6684:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790920315.168270:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790920315.168295:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88eb06664d40) 00000020:00000080:2.0:1790920315.168314:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790920315.192911:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790920315.193262:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790920315.252390:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790920315.280939:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790920315.280984:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790920315.281526:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790920315.281554:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790920315.283508:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790920315.283526:0:6684:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790920315.283547:0:6684:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2a49158445469ebc 00000020:01000004:0.0:1790920315.283570:0:6684:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1790920315.283596:0:6684:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790920315.283601:0:6684:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790920315.283608:0:6684:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790920315.283614:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790920315.283632:0:6684:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88eb3b9d3380) 00000020:00000080:0.0:1790920315.283891:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1790920315.292219:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790920315.292635:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790920315.292643:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790920315.295099:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790920315.295111:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790920315.300803:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790920315.300823:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790920315.311286:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920315.311551:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790920315.311559:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790920315.312776:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790920315.312786:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790920315.344614:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920315.345187:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790920315.345195:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790920315.347171:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790920315.347187:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790920315.350248:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790920315.350265:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790920315.354241:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920315.354642:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790920315.354709:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790920315.355597:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790920315.355607:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790920315.431164:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920315.432956:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790920315.432972:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790920315.458664:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790920315.458686:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790920315.459865:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790920315.460784:0:6684:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790920315.460794:0:6684:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790920315.524908:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790920315.524955:0:6684:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790920315.524960:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790920315.524963:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790920315.524964:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920315.524965:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920315.524967:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920315.524968:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920315.524970:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920315.524976:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920315.524978:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920315.524979:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920315.524981:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920315.524985:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790920315.524987:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790920315.524989:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790920315.524989:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920315.524990:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920315.524991:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920315.524992:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920315.524993:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920315.524994:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920315.524995:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920315.524996:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920315.524997:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920315.525030:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790920315.525065:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972146176:0@lo:253: 00000100:00100000:2.0:1790920315.525152:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920315.525228:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696600 going to sleep for 11 seconds 00000100:00100000:3.0:1790920315.529656:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146176 00000100:00100000:3.0:1790920315.529680:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146176 00000100:00100000:3.0:1790920315.529838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790920315.529850:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972146176:12345-0@lo:253: 20000000:01000000:3.0:1790920315.529898:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790920315.529903:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790920315.529910:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790920315.529914:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790920315.531128:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920315.531384:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1790920315.531401:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790920315.531441:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1790920315.531449:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790920315.531476:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1790920315.531522:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1790920315.531951:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790920315.531975:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:3.0:1790920315.531978:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790920315.532012:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790920315.532019:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790920315.532078:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790920315.532086:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:3.0:1790920315.532118:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790920315.532127:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790920315.532156:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790920315.532205:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1790920315.540217:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790920315.540260:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:3.0:1790920315.540264:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790920315.540302:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790920315.540310:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790920315.540343:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790920315.540351:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:3.0:1790920315.540394:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790920315.540404:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790920315.540432:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1790920315.540477:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1790920315.540495:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1790920315.540498:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1790920315.540505:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790920315.540512:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790920315.540515:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790920315.540530:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790920315.540533:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790920315.540571:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790920315.540575:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790920315.546187:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1790920315.547010:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1790920315.547079:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1790920315.547164:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1790920315.547178:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790920315.547182:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790920315.554941:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790920315.555077:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790920315.555136:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1790920315.564300:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1790920315.564363:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1790920315.564451:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1790920315.564467:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790920315.564471:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790920315.567331:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1790920315.567442:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1790920315.567509:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1790920315.567937:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1790920315.567987:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1790920315.568072:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1790920315.568096:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790920315.568119:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568154:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb00031400/0x2a49158445469de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469ddc expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568163:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029ee400/0x2a49158445469dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469df8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568171:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb00030800/0x2a49158445469e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e68 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568180:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568231:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb00030800/0x2a49158445469e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469e68 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568248:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb00030800/0x2a49158445469e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469e68 expref: 12 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.568264:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1877915972146304:0@lo:104: 00000100:00100000:0.0:1790920315.568348:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790920315.568414:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029ee400/0x2a49158445469dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469df8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568423:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029ee400/0x2a49158445469dff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469df8 expref: 12 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.568432:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1877915972146432:0@lo:104: 00000100:00100000:0.0:1790920315.568454:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790920315.568486:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb00031400/0x2a49158445469de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469ddc expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.568501:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb00031400/0x2a49158445469de3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469ddc expref: 12 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.568511:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1877915972146560:0@lo:104: 00000100:00100000:0.0:1790920315.568534:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.568545:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721a300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.568628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146304 00000100:00100000:1.0:1790920315.568637:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146304 00000100:00100000:1.0:1790920315.568676:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146432 00000100:00100000:1.0:1790920315.568680:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146432 00000100:00100000:1.0:1790920315.568689:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146560 00000100:00100000:1.0:1790920315.568691:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146560 00000100:00100000:1.0:1790920315.568705:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920315.568715:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:5837:x1877915972146304:12345-0@lo:104: 00010000:00010000:1.0:1790920315.568731:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.568834:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790920315.568840:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:5837:x1877915972146304:12345-0@lo:104: Request processed in 126us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.568848:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920315.568868:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790920315.568874:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:5837:x1877915972146432:12345-0@lo:104: 00010000:00010000:1.0:1790920315.568882:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.568912:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790920315.568917:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:5837:x1877915972146432:12345-0@lo:104: Request processed in 44us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.568922:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790920315.568934:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790920315.568940:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5837:x1877915972146560:12345-0@lo:104: 00010000:00010000:1.0:1790920315.568947:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.568973:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790920315.568978:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5837:x1877915972146560:12345-0@lo:104: Request processed in 39us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.568983:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1790920315.569000:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790920315.569007:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569015:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cf600 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920315.569025:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569047:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920315.569055:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920315.569061:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920315.569096:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569103:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920315.569125:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569132:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421cf600/0x2a49158445469e68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e6f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569146:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790920315.569149:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569156:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139d400 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920315.569158:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569164:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920315.569182:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920315.569186:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920315.569200:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569205:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920315.569211:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569218:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb0139d400/0x2a49158445469df8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469dff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569227:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920315.569230:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569236:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139ce00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920315.569239:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569245:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920315.569251:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920315.569256:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920315.569276:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569282:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920315.569297:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569303:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb0139ce00/0x2a49158445469ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469de3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569319:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920315.569321:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920315.569322:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920315.569329:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920315.569349:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972146944:0@lo:103: 00000100:00100000:1.0:1790920315.569381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920315.569423:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146944 00000100:00100000:1.0:1790920315.569427:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146944 00010000:00010000:1.0:1790920315.569459:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb00031400/0x2a49158445469de3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469ddc expref: 13 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920315.569481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920315.569487:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:3306:x1877915972146944:12345-0@lo:103: 00010000:00010000:1.0:1790920315.569497:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920315.569503:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb00031400/0x2a49158445469de3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469ddc expref: 13 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569512:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb00031400/0x2a49158445469de3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469ddc expref: 13 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.569529:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920315.569563:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:3306:x1877915972146944:12345-0@lo:103: Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.569569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920315.569608:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972146944:0@lo:103: 00000100:00100000:2.0:1790920315.569727:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972146688:0@lo:103: 00000100:00100000:2.0:1790920315.569785:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920315.569809:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920315.569814:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972146816:0@lo:103: 00000100:00100000:2.0:1790920315.569832:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.569927:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1877915972146304:0@lo:104: 00000100:00100000:0.0:1790920315.569936:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1877915972146432:0@lo:104: 00010000:00010000:0.0:1790920315.569943:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00031400/0x2a49158445469de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469ddc expref: 12 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.569954:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1877915972146560:0@lo:104: 00010000:00010000:0.0:1790920315.569972:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920315.570229:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146688 00000100:00100000:1.0:1790920315.570234:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146688 00010000:00010000:1.0:1790920315.570255:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb00030800/0x2a49158445469e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e68 expref: 12 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920315.570280:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972146816 00000100:00100000:1.0:1790920315.570284:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972146816 00010000:00010000:1.0:1790920315.570295:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029ee400/0x2a49158445469dff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469df8 expref: 13 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920315.570307:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790920315.570313:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:3304:x1877915972146688:12345-0@lo:103: 00010000:00010000:1.0:1790920315.570321:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920315.570324:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb00030800/0x2a49158445469e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e68 expref: 13 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570334:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb00030800/0x2a49158445469e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469e68 expref: 13 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570345:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030800/0x2a49158445469e6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469e68 expref: 13 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570357:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920315.570390:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3304:x1877915972146688:12345-0@lo:103: Request processed in 77us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.570397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790920315.570423:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790920315.570428:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:3304:x1877915972146816:12345-0@lo:103: 00010000:00010000:1.0:1790920315.570436:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920315.570440:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029ee400/0x2a49158445469dff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469df8 expref: 11 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570449:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029ee400/0x2a49158445469dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469df8 expref: 11 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570460:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029ee400/0x2a49158445469dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469df8 expref: 11 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570474:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570483:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570643:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570653:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570661:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570669:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570675:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920315.570679:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570695:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570718:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.570729:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920315.570774:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:3304:x1877915972146816:12345-0@lo:103: Request processed in 345us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.570781:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790920315.570808:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972146816:0@lo:103: 00000100:00100000:1.0:1790920315.570815:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972146688:0@lo:103: 00010000:00010000:2.0:1790920315.570873:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.570881:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.570898:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030200/0x2a49158445469eca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790920315.570914:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790920315.686134:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:6684:x1877915972146176:12345-0@lo:253: Request processed in 156274us (160970us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920315.686150:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790920315.686449:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972146176:0@lo:253: 10000000:01000000:2.0:1790920315.686468:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790920315.686472:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790920315.686474:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790920315.686475:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920315.686476:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790920315.686477:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920315.686478:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920315.686479:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920315.686481:0:6684:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790920315.686482:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920315.686484:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790920315.686511:0:6684:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88eb05888000 from lustre-OST0000 10000000:01000000:2.0:1790920315.686543:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790920315.686546:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790920315.686554:0:6684:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88eb05f10000 local copy 10000000:01000000:2.0:1790920315.686559:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790920315.686601:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.686614:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.686624:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920315.686712:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147072:0@lo:101: 00000100:00100000:2.0:1790920315.687004:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920315.687129:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.687307:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147072 00000100:00100000:1.0:1790920315.687316:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147072 00000100:00100000:1.0:1790920315.687475:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790920315.687486:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+9:6684:x1877915972147072:12345-0@lo:101: 00010000:00010000:1.0:1790920315.687503:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920315.687522:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029ee400/0x2a49158445469ed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469ed1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.687549:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029ee400/0x2a49158445469ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469ed1 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.687563:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029ee400/0x2a49158445469ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469ed1 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.687573:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029ee400, rc 0) 00000100:00100000:1.0:1790920315.687632:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:6684:x1877915972147072:12345-0@lo:101: Request processed in 148us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.687638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790920315.687784:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147072:0@lo:101: 00010000:00010000:0.0:1790920315.687800:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.687811:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.687934:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147200:0@lo:501: 00000100:00100000:0.0:1790920315.687965:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.688473:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f51cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920315.688523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147200 00000100:00100000:2.0:1790920315.688529:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147200 00000100:00100000:2.0:1790920315.688558:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790920315.688564:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:6684:x1877915972147200:12345-0@lo:501: 00000100:00100000:2.0:1790920315.688858:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:6684:x1877915972147200:12345-0@lo:501: Request processed in 292us (891us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790920315.688865:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790920315.689013:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147200:0@lo:501: 10000000:01000000:0.0:1790920315.689051:0:6684:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790920315.689082:0:6684:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790920315.689090:0:6684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.689100:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.689107:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.689133:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790920315.689159:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88eb05888000 10000000:01000000:0.0:1790920315.689164:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790920315.689169:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88eb05f10000 10000000:01000000:0.0:1790920315.689172:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790920315.689175:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88eb05f10000 from 1 10000000:01000000:0.0:1790920315.689178:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790920315.689467:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.689476:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.689486:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.689502:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147328:0@lo:101: 00000100:00100000:0.0:1790920315.689539:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.689574:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f516c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790920315.689703:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920315.689711:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.689719:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139cc00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:2.0:1790920315.689723:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.689731:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790920315.689738:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920315.689831:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790920315.689855:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.689862:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790920315.689912:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972147456:0@lo:103: 00000100:00100000:0.0:1790920315.689942:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790920315.689994:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.690013:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb0139cc00/0x2a49158445469ed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2a49158445469ed8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.690042:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920315.690043:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920315.690045:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920315.690056:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147328 00000100:00100000:2.0:1790920315.690061:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147328 00000100:00100000:2.0:1790920315.690091:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790920315.690099:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:6684:x1877915972147328:12345-0@lo:101: 00010000:00010000:2.0:1790920315.690109:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920315.690125:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb0139ce00/0x2a49158445469ee6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469edf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.690146:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139ce00/0x2a49158445469ee6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469edf expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.690157:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb0139ce00/0x2a49158445469ee6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469edf expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.690165:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139ce00, rc 0) 00000100:00100000:2.0:1790920315.691080:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147328:12345-0@lo:101: Request processed in 976us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920315.691089:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790920315.691145:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147456 00000100:00100000:2.0:1790920315.691150:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147456 00000100:00100000:2.0:1790920315.691186:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920315.691193:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:3307:x1877915972147456:12345-0@lo:103: 00010000:00010000:2.0:1790920315.691227:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920315.691245:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029ee400/0x2a49158445469ed8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a49158445469ed1 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.691260:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920315.691838:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:3307:x1877915972147456:12345-0@lo:103: Request processed in 643us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920315.691846:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920315.691970:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147328:0@lo:101: 00010000:00010000:1.0:1790920315.691994:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469ee6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.692006:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469ee6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920315.692041:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790920315.692092:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469ee6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.692102:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469ee6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920315.692110:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790920315.692117:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790920315.692124:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790920315.692126:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790920315.692157:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.692165:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.692174:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920315.692218:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147584:0@lo:101: 00000100:00100000:1.0:1790920315.692261:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920315.692303:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920315.692468:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147584 00000100:00100000:3.0:1790920315.692475:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147584 00000100:00100000:3.0:1790920315.692520:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790920315.692529:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+10:6684:x1877915972147584:12345-0@lo:101: 00010000:00010000:3.0:1790920315.692543:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920315.692556:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469eed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920315.692574:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469eed expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920315.692595:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469eed expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920315.692603:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421cfc00, rc 0) 00000100:00100000:3.0:1790920315.692638:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147584:12345-0@lo:101: Request processed in 110us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920315.692655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790920315.692840:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147584:0@lo:101: 00010000:00010000:1.0:1790920315.692853:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.692860:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920315.692976:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147712:0@lo:501: 00000100:00100000:1.0:1790920315.693002:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920315.693028:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.693054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147712 00000100:00100000:1.0:1790920315.693058:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147712 00000100:00100000:1.0:1790920315.693077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790920315.693083:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147712:12345-0@lo:501: 00000100:00100000:1.0:1790920315.693955:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147712:12345-0@lo:501: Request processed in 867us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.693965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790920315.694076:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972147456:0@lo:103: 00000100:00100000:3.0:1790920315.694175:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147712:0@lo:501: 00000100:00100000:3.0:1790920315.694314:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147840:0@lo:503: 00000100:00100000:3.0:1790920315.694435:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920315.694474:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f55cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920315.694534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147840 00000100:00100000:0.0:1790920315.694540:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147840 00000100:00100000:0.0:1790920315.694580:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790920315.694589:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147840:12345-0@lo:503: 00000100:00100000:0.0:1790920315.694874:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147840:12345-0@lo:503: Request processed in 285us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920315.694881:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790920315.695012:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147840:0@lo:503: 00000040:00080000:3.0:1790920315.695525:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790920315.695603:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147968:0@lo:502: 00000100:00100000:3.0:1790920315.695730:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920315.695847:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f55cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920315.696050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972147968 00000100:00100000:0.0:1790920315.696056:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972147968 00000100:00100000:0.0:1790920315.696128:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790920315.696137:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147968:12345-0@lo:502: 00000100:00100000:0.0:1790920315.696557:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972147968:12345-0@lo:502: Request processed in 421us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920315.696564:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790920315.696724:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972147968:0@lo:502: 00000040:00080000:1.0:1790920315.697130:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790920315.697188:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790920315.697639:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790920315.697883:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790920315.697925:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790920315.697974:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790920315.698016:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148096:0@lo:502: 00000100:00100000:1.0:1790920315.698086:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920315.698184:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790920315.698303:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148096 00000100:00100000:0.0:1790920315.698310:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148096 00000100:00100000:0.0:1790920315.698429:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790920315.698440:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972148096:12345-0@lo:502: 00000100:00100000:0.0:1790920315.698624:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972148096:12345-0@lo:502: Request processed in 185us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920315.698631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790920315.698735:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148096:0@lo:502: 00000040:00080000:2.0:1790920315.698850:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790920315.698860:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1790920315.699786:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790920315.699797:0:6703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1790920315.699810:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920315.699812:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790920315.699820:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790920315.699840:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88eb3b9d19c0) 00000020:00000080:0.0:1790920315.699865:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790920315.699871:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790920315.699950:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb05888000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790920315.699958:0:6703:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790920315.699965:0:6703:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2a49158445469f02 00010000:00010000:0.0:1790920315.706938:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1790920315.707533:0:6703:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1790920315.721550:0:6703:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790920315.721937:0:6703:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1790920315.748337:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790920315.748998:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790920315.752511:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790920315.752528:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920315.752536:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920315.752539:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790920315.752543:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920315.752547:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920315.752549:0:6703:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790920315.752552:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790920315.752554:0:6703:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790920315.752642:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920315.752645:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920315.752662:0:6703:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790920315.752667:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790920315.753127:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1790920315.753170:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790920315.753197:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.753212:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920315.753223:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb05888000 from 1 10000000:01000000:0.0:1790920315.753227:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920315.753282:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.753292:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.753306:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.753348:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148224:0@lo:101: 00000100:00100000:0.0:1790920315.753447:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.753517:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920315.754359:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148224 00000100:00100000:2.0:1790920315.754376:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148224 00000100:00100000:2.0:1790920315.754447:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790920315.754459:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:6684:x1877915972148224:12345-0@lo:101: 00010000:00010000:2.0:1790920315.754478:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920315.754498:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469f09 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.754554:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469f09 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.754569:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f09 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.754579:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139cc00, rc 0) 00000100:00100000:2.0:1790920315.754681:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148224:12345-0@lo:101: Request processed in 225us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920315.754688:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790920315.755829:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148224:0@lo:101: 00010000:00010000:0.0:1790920315.755872:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.755891:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.756073:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148352:0@lo:501: 00000100:00100000:0.0:1790920315.756140:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.756194:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920315.756496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148352 00000100:00100000:2.0:1790920315.756513:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148352 00000100:00100000:2.0:1790920315.756629:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790920315.756652:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148352:12345-0@lo:501: 00000100:00100000:2.0:1790920315.757086:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148352:12345-0@lo:501: Request processed in 446us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920315.757096:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790920315.761979:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148352:0@lo:501: 00000100:00100000:0.0:1790920315.762089:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148480:0@lo:503: 00000100:00100000:0.0:1790920315.762212:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.763511:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148480 00000100:00100000:0.0:1790920315.763526:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148480 00000100:00100000:0.0:1790920315.763595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790920315.763605:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148480:12345-0@lo:503: 00000100:00100000:0.0:1790920315.765855:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148480:12345-0@lo:503: Request processed in 2243us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920315.765870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790920315.765989:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920315.766018:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148480:0@lo:503: 00000040:00080000:0.0:1790920315.767897:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790920315.768016:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148608:0@lo:502: 00000100:00100000:0.0:1790920315.768129:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.768187:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.768429:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148608 00000100:00100000:1.0:1790920315.768445:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148608 00000100:00100000:1.0:1790920315.768510:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790920315.768522:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148608:12345-0@lo:502: 00000100:00100000:1.0:1790920315.771295:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148608:12345-0@lo:502: Request processed in 2765us (3168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.771309:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790920315.771429:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148608:0@lo:502: 00000040:00080000:2.0:1790920315.772989:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790920315.773106:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790920315.773170:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148736:0@lo:502: 00000100:00100000:2.0:1790920315.773267:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920315.773439:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696240 going to sleep for 11 seconds 00000100:00100000:0.0:1790920315.773545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148736 00000100:00100000:0.0:1790920315.773555:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148736 00000100:00100000:0.0:1790920315.773661:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790920315.773675:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148736:12345-0@lo:502: 00000100:00100000:1.0:1790920315.774064:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148736:12345-0@lo:502: Request processed in 385us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.774078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790920315.774133:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148736:0@lo:502: 00000040:00080000:2.0:1790920315.774436:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790920315.774449:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790920315.784531:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920315.784553:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920315.784555:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790920315.784575:0:6707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb05888000 00000020:00000080:3.0:1790920315.784578:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790920315.784604:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920315.784607:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920315.784609:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790920315.784612:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790920315.784719:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790920315.784809:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790920315.784839:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.784854:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920315.784917:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790920315.784920:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88eb05888000 10000000:01000000:0.0:1790920315.784925:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88eb05888000 10000000:01000000:0.0:1790920315.784930:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790920315.784937:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb05888000 from 1 10000000:01000000:0.0:1790920315.784941:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790920315.784991:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.785001:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.785012:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.785066:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148864:0@lo:101: 00000100:00100000:0.0:1790920315.785149:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.785197:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a480 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.785608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148864 00000100:00100000:1.0:1790920315.785617:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148864 00000100:00100000:1.0:1790920315.785674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790920315.785684:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972148864:12345-0@lo:101: 00010000:00010000:1.0:1790920315.785700:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920315.785716:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469f17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.785743:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469f17 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.785802:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f17 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.785811:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029ef400, rc 0) 00000100:00100000:1.0:1790920315.785876:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972148864:12345-0@lo:101: Request processed in 193us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.785884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790920315.786004:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148864:0@lo:101: 00010000:00010000:0.0:1790920315.786020:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.786040:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.786152:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148992:0@lo:501: 00000100:00100000:0.0:1790920315.786182:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.786203:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a480 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.786334:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972148992 00000100:00100000:1.0:1790920315.786339:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972148992 00000100:00100000:1.0:1790920315.786377:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790920315.786387:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972148992:12345-0@lo:501: 00000100:00100000:1.0:1790920315.786911:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972148992:12345-0@lo:501: Request processed in 524us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.786920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790920315.787015:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972148992:0@lo:501: 00000100:00100000:0.0:1790920315.787062:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149120:0@lo:503: 00000100:00100000:0.0:1790920315.787109:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.787131:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a480 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.787186:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972149120 00000100:00100000:1.0:1790920315.787190:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972149120 00000100:00100000:1.0:1790920315.787254:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790920315.787263:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972149120:12345-0@lo:503: 00000100:00100000:1.0:1790920315.787449:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972149120:12345-0@lo:503: Request processed in 187us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.787456:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790920315.797922:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149120:0@lo:503: 00000040:00080000:2.0:1790920315.800257:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790920315.801550:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149248:0@lo:502: 00000100:00100000:2.0:1790920315.801859:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920315.801958:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790920315.804548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972149248 00000100:00100000:0.0:1790920315.804712:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972149248 00000100:00100000:0.0:1790920315.804859:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790920315.804872:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972149248:12345-0@lo:502: 00000100:00100000:0.0:1790920315.805248:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972149248:12345-0@lo:502: Request processed in 378us (3388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920315.805259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790920315.805420:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149248:0@lo:502: 00000040:00080000:2.0:1790920315.808973:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1790920315.809103:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1790920315.809140:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1790920315.809194:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1790920315.809228:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1790920315.809279:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1790920315.809316:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1790920315.809350:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1790920315.809395:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1790920315.809428:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1790920315.809484:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1790920315.809537:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1790920315.809592:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1790920315.809625:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1790920315.809671:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1790920315.809706:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1790920315.809794:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1790920315.809869:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1790920315.809914:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1790920315.809951:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1790920315.810016:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1790920315.810072:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1790920315.810108:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1790920315.810156:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1790920315.810194:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1790920315.810231:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1790920315.810303:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1790920315.810344:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1790920315.810402:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149376:0@lo:502: 00000100:00100000:2.0:1790920315.810495:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920315.818968:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.822532:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972149376 00000100:00100000:1.0:1790920315.822550:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972149376 00000100:00100000:1.0:1790920315.822985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790920315.822998:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972149376:12345-0@lo:502: 00000100:00100000:1.0:1790920315.824348:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972149376:12345-0@lo:502: Request processed in 1341us (13842us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.824361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790920315.824802:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149376:0@lo:502: 00000040:00080000:2.0:1790920315.824940:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1790920315.824968:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790920315.827517:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790920315.827539:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88eb3b9d0000) 00000020:00000080:0.0:1790920315.827575:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1790920315.827991:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb05888000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790920315.828001:0:6708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb05888000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790920315.828004:0:6708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb05888000 3 00010000:00080000:0.0:1790920315.828064:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb3f9aa800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.134@tcp at head 00010000:00010000:2.0:1790920315.834080:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1790920315.835548:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790920315.835606:0:6708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790920315.835620:0:6708:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2a49158445469f2c 00000100:00080000:2.0:1790920315.835633:0:6708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790920315.836067:0:6708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88eb3f9aa800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1790920315.836109:0:6708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb10a2a680 x1877915972149504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790920315.836149:0:6708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790920315.836219:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1877915972149504:0@lo:38: 00000100:00100000:3.0:1790920315.836322:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920315.837311:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972149760:0@lo:400: 00000100:00100000:1.0:1790920315.837380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920315.837444:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790920315.837472:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972149632:0@lo:400: 00000100:00100000:1.0:1790920315.837506:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920315.837546:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972149504 00000100:00100000:1.0:1790920315.837566:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972149504 00000100:00100000:1.0:1790920315.837602:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972149760 00000100:00100000:1.0:1790920315.837605:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972149760 00000100:00100000:1.0:1790920315.837634:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920315.837920:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972149760:12345-0@lo:400: 00000100:00100000:1.0:1790920315.837989:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972149760:12345-0@lo:400: Request processed in 75us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.837997:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920315.838019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920315.838023:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1877915972149504:12345-0@lo:38: 00010000:00080000:1.0:1790920315.838077:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:1.0:1790920315.838495:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2a49158445469f33 00000004:00100000:1.0:1790920315.838516:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790920315.838716:0:5845:0:(import.c:65:import_set_state_nolock()) ffff88eb344b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790920315.838804:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877915972149504:12345-0@lo:38: Request processed in 778us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.838812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790920315.838876:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88eb10a2a680 x1877915972149504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790920325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920315.838889:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790920315.838897:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790920315.838907:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790920315.838913:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790920315.838916:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f9aa800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790920315.838930:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1877915972149504:0@lo:38: 00010000:00080000:1.0:1790920315.838973:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88eb3447e300 x1877915972149760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920315.838984:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972149760:0@lo:400: 00000100:00100000:1.0:1790920315.840238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972149632 00000100:00100000:1.0:1790920315.840249:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972149632 00000100:00100000:1.0:1790920315.841339:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790920315.841359:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:3305:x1877915972149632:12345-0@lo:400: 00000100:00100000:1.0:1790920315.841483:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:3305:x1877915972149632:12345-0@lo:400: Request processed in 132us (3975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920315.841566:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972149632:0@lo:400: 00000040:00080000:3.0:1790920315.844337:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1790920315.850456:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790920315.850772:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790920315.850794:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.850807:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790920315.850866:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790920315.850869:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790920315.850871:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790920315.850872:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790920315.850874:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790920315.850875:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790920315.850876:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790920315.850878:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790920315.850879:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790920315.850882:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790920315.850883:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790920315.850888:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1790920315.850891:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790920315.850893:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790920315.850894:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790920315.850896:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790920315.850897:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790920315.850898:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790920315.850899:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790920315.850900:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790920315.850901:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790920315.850903:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790920315.850909:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790920315.850942:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790920315.850962:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149888:0@lo:253: 00000100:00100000:0.0:1790920315.851059:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.851112:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.851471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790920315.851531:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972149888 00000100:00100000:1.0:1790920315.851539:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972149888 00000100:00100000:1.0:1790920315.851603:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790920315.851613:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:6684:x1877915972149888:12345-0@lo:253: 20000000:01000000:1.0:1790920315.851669:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790920315.851684:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790920315.915093:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790920315.915125:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790920315.915203:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790920315.915281:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790920315.915309:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.915329:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb421ce200/0x2a49158445469e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469e92 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.915337:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.915787:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb421ce200/0x2a49158445469e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469e92 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.915804:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb421ce200/0x2a49158445469e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469e92 expref: 13 pid: 5840 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.915821:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877915972150016:0@lo:104: 00000100:00100000:0.0:1790920315.915895:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920315.915955:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920315.919730:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150016 00000100:00100000:1.0:1790920315.919794:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150016 00000100:00100000:1.0:1790920315.919871:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790920315.919882:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5861:x1877915972150016:12345-0@lo:104: 00010000:00010000:1.0:1790920315.919903:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.920016:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790920315.920036:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5861:x1877915972150016:12345-0@lo:104: Request processed in 144us (4130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920315.920064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1790920315.920091:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920315.920098:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.920107:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029efe00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920315.920111:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.920121:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920315.920130:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920315.920136:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920315.920180:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.920187:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920315.920205:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.920212:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb029efe00/0x2a49158445469e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469e99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920315.920233:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920315.920235:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920315.920237:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920315.920254:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972150144:0@lo:103: 00000100:00100000:1.0:1790920315.920712:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920315.920831:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150144 00000100:00100000:2.0:1790920315.920846:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150144 00010000:00010000:2.0:1790920315.920890:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb421ce200/0x2a49158445469e99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e92 expref: 14 pid: 5840 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920315.920949:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920315.920958:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:3306:x1877915972150144:12345-0@lo:103: 00010000:00010000:2.0:1790920315.920974:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920315.920980:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb421ce200/0x2a49158445469e99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469e92 expref: 14 pid: 5840 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.920992:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb421ce200/0x2a49158445469e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469e92 expref: 14 pid: 5840 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921017:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921038:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790920315.921072:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005791395s 00010000:00010000:2.0:1790920315.921077:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921085:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921093:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921100:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921107:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920315.921111:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921119:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921129:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920315.921140:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920315.921211:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:3306:x1877915972150144:12345-0@lo:103: Request processed in 255us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920315.921219:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920315.921320:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972150144:0@lo:103: 00010000:00010000:0.0:1790920315.921478:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421ce200/0x2a49158445469e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469e92 expref: 13 pid: 5840 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.921497:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877915972150016:0@lo:104: 00010000:00010000:0.0:1790920315.921520:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.921544:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.921551:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920315.921740:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030200/0x2a49158445469f3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920315.951103:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:6684:x1877915972149888:12345-0@lo:253: Request processed in 99477us (100029us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920315.951121:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790920315.951261:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:6684:1877915972149888:0@lo:253: 10000000:01000000:1.0:1790920315.951280:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790920315.951284:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790920315.951286:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790920315.951287:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790920315.951289:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790920315.951290:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790920315.951303:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790920315.951305:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790920315.951307:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790920315.951309:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790920315.951311:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790920315.951312:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790920315.951332:0:6684:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790920315.953834:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1790920315.960042:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920315.960324:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790920315.960574:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920315.961159:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790920315.961823:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920315.963544:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790920315.965583:0:6684:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790920316.217385:0:6684:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790920316.217394:0:6684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790920316.217430:0:6684:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790920316.217497:0:6684:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790920316.217514:0:6684:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790920316.217543:0:6684:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1790920316.969990:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920317.994768:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920319.017080:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920320.043042:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920321.064937:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920321.130083:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920321.130115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972150272:0@lo:400: 00000100:00100000:0.0:1790920321.130202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920321.130260:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972150400:0@lo:400: 00000100:00100000:0.0:1790920321.130292:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920321.130314:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920321.130319:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972150528:0@lo:400: 00000100:00100000:0.0:1790920321.130379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920321.130422:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150272 00000100:00100000:0.0:1790920321.130433:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150272 00000100:00100000:0.0:1790920321.130493:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790920321.130505:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3306:x1877915972150272:12345-0@lo:400: 00000100:00100000:0.0:1790920321.130663:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3306:x1877915972150272:12345-0@lo:400: Request processed in 159us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920321.130673:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790920321.130717:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150400 00000100:00100000:0.0:1790920321.130722:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150400 00000100:00100000:0.0:1790920321.130778:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150528 00000100:00100000:0.0:1790920321.130782:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150528 00000100:00100000:0.0:1790920321.130812:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920321.130819:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972150400:12345-0@lo:400: 00000100:00100000:0.0:1790920321.130866:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972150400:12345-0@lo:400: Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920321.130874:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920321.130887:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790920321.130894:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972150528:12345-0@lo:400: 00000100:00100000:0.0:1790920321.130921:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972150528:12345-0@lo:400: Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920321.130941:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790920321.130998:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb0562b100 x1877915972150528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920321.131014:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972150528:0@lo:400: 00010000:00080000:0.0:1790920321.131026:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb05629880 x1877915972150400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920321.131036:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972150400:0@lo:400: 00000100:00100000:0.0:1790920321.131076:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972150272:0@lo:400: 00000100:00080000:3.0:1790920321.131365:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790920322.090076:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790920322.672234:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790920323.114977:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790920323.176842:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790920323.176852:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb09ba1000 from 21 10000000:01000000:1.0:1790920323.176859:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790920323.176934:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.176947:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.176959:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920323.176988:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972150656:0@lo:101: 00000100:00100000:1.0:1790920323.177062:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920323.177133:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.177228:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150656 00000100:00100000:2.0:1790920323.177239:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150656 00000100:00100000:2.0:1790920323.177304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790920323.177314:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972150656:12345-0@lo:101: 00010000:00010000:2.0:1790920323.177331:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920323.177346:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469f41 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.177373:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469f41 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.177384:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f41 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.177393:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139ca00, rc 0) 00000100:00100000:2.0:1790920323.177443:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972150656:12345-0@lo:101: Request processed in 131us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.177449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790920323.177632:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972150656:0@lo:101: 00010000:00010000:1.0:1790920323.177664:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.177674:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920323.177735:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972150784:0@lo:501: 00000100:00100000:1.0:1790920323.177791:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920323.177814:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.177871:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150784 00000100:00100000:2.0:1790920323.177875:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150784 00000100:00100000:2.0:1790920323.177913:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790920323.177921:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972150784:12345-0@lo:501: 00000100:00100000:2.0:1790920323.178301:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972150784:12345-0@lo:501: Request processed in 381us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.178308:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790920323.178381:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972150784:0@lo:501: 00000100:00100000:1.0:1790920323.178408:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972150912:0@lo:503: 00000100:00100000:1.0:1790920323.178449:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920323.178480:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.178530:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972150912 00000100:00100000:2.0:1790920323.178535:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972150912 00000100:00100000:2.0:1790920323.178565:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790920323.178572:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972150912:12345-0@lo:503: 00000100:00100000:2.0:1790920323.178908:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972150912:12345-0@lo:503: Request processed in 336us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.178915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790920323.178964:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972150912:0@lo:503: 00000100:00100000:2.0:1790920323.179415:0:7073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7073:1877915972151040:0@lo:502: 00000100:00100000:2.0:1790920323.179453:0:7073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.179481:0:7073:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920323.179531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151040 00000100:00100000:3.0:1790920323.179538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151040 00000100:00100000:3.0:1790920323.179577:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790920323.179585:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7073:x1877915972151040:12345-0@lo:502: 00000100:00100000:3.0:1790920323.179868:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7073:x1877915972151040:12345-0@lo:502: Request processed in 283us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920323.179875:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790920323.180043:0:7073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7073:1877915972151040:0@lo:502: 00000100:00100000:1.0:1790920323.180100:0:7073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7073:1877915972151168:0@lo:502: 00000100:00100000:1.0:1790920323.180142:0:7073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920323.180165:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151168 00000100:00100000:1.0:1790920323.180169:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151168 00000100:00100000:1.0:1790920323.180190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790920323.180196:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7073:x1877915972151168:12345-0@lo:502: 00000100:00100000:1.0:1790920323.180335:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7073:x1877915972151168:12345-0@lo:502: Request processed in 138us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920323.180342:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790920323.180383:0:7073:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a900 going to sleep for 11 seconds 00000100:00100000:1.0:1790920323.180395:0:7073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7073:1877915972151168:0@lo:502: 00000040:00080000:1.0:1790920323.180422:0:7073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790920323.180656:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790920323.180673:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790920323.180684:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.180695:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920323.180706:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790920323.180708:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb09ba1000 from 4 10000000:01000000:3.0:1790920323.180712:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790920323.180781:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.180791:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.180802:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920323.180817:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151296:0@lo:101: 00000100:00100000:3.0:1790920323.180845:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920323.180863:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920323.180929:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151296 00000100:00100000:1.0:1790920323.180933:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151296 00000100:00100000:1.0:1790920323.180965:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790920323.180972:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972151296:12345-0@lo:101: 00010000:00010000:1.0:1790920323.180981:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920323.180994:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469f4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.181017:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469f4f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.181027:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f4f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.181035:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029efe00, rc 0) 00000100:00100000:1.0:1790920323.181073:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972151296:12345-0@lo:101: Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920323.181079:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790920323.181176:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151296:0@lo:101: 00010000:00010000:3.0:1790920323.181191:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.181212:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920323.181257:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151424:0@lo:256: 00000100:00100000:3.0:1790920323.181291:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920323.181314:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.181356:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151424 00000100:00100000:2.0:1790920323.181360:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151424 00000100:00100000:2.0:1790920323.181389:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790920323.181396:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972151424:12345-0@lo:256: 20000000:01000000:2.0:1790920323.181410:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790920323.181426:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790920323.181428:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790920323.181510:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972151424:12345-0@lo:256: Request processed in 114us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.181517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790920323.181606:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151424:0@lo:256: 10000000:01000000:3.0:1790920323.181650:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790920323.181656:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.181664:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920323.181672:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790920323.181674:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790920323.181677:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790920323.181694:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.181702:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.181710:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920323.181721:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151552:0@lo:101: 00000100:00100000:3.0:1790920323.181801:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920323.181819:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.181897:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151552 00000100:00100000:2.0:1790920323.181901:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151552 00000100:00100000:2.0:1790920323.181926:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790920323.181934:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972151552:12345-0@lo:101: 00010000:00010000:2.0:1790920323.181941:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920323.181951:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469f5d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.181966:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469f5d expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.181986:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f5d expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.181994:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139c800, rc 0) 00000100:00100000:2.0:1790920323.182022:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972151552:12345-0@lo:101: Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.182028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790920323.182111:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151552:0@lo:101: 00010000:00010000:3.0:1790920323.182123:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920323.182131:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920323.182180:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151680:0@lo:501: 00000100:00100000:3.0:1790920323.182207:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920323.182273:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.186560:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151680 00000100:00100000:2.0:1790920323.186580:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151680 00000100:00100000:3.0:1790920323.188081:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790920323.188096:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972151680:12345-0@lo:501: 00000100:00100000:1.0:1790920323.188603:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151680:0@lo:501: 00000100:00100000:1.0:1790920323.188667:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151808:0@lo:503: 00000100:00100000:3.0:1790920323.188732:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972151680:12345-0@lo:501: Request processed in 638us (6522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920323.188742:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790920323.189380:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920323.189780:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a540 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.189963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151808 00000100:00100000:2.0:1790920323.189971:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151808 00000100:00100000:2.0:1790920323.190056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790920323.190067:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972151808:12345-0@lo:503: 00000100:00100000:2.0:1790920323.194947:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972151808:12345-0@lo:503: Request processed in 385us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.194969:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790920323.195218:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972151808:0@lo:503: 00000100:00100000:3.0:1790920323.195863:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05840e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7074:1877915972151936:0@lo:502: 00000100:00100000:3.0:1790920323.199143:0:7074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920323.199212:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972151936 00000100:00100000:3.0:1790920323.199223:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972151936 00000100:00100000:3.0:1790920323.199281:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790920323.199291:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7074:x1877915972151936:12345-0@lo:502: 00000100:00100000:3.0:1790920323.199694:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7074:x1877915972151936:12345-0@lo:502: Request processed in 402us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920323.199704:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790920323.199805:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920323.199832:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05840e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7074:1877915972151936:0@lo:502: 00000020:01000000:3.0:1790920323.199872:0:7074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790920323.199881:0:7074:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790920323.200060:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920323.200063:0:7074:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790920323.200070:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790920323.200074:0:7074:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:3.0:1790920323.200096:0:7074:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790920323.200098:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790920323.200124:0:7074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88eb41c00000) 00000020:00000080:3.0:1790920323.200147:0:7074:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1790920323.200154:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790920323.200256:0:7074:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790920323.200262:0:7074:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790920323.200270:0:7074:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a49158445469f72 00010000:00080000:3.0:1790920323.200302:0:7074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb3f49f800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:3.0:1790920323.200554:0:7074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1790920323.273374:0:7074:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790920323.273398:0:7074:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790920323.274102:0:7074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920323.274291:0:7074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920323.274345:0:7074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1790920323.274405:0:7074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790920323.277021:0:7077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790920323.277029:0:7077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790920323.277969:0:7074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790920323.277985:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790920323.278028:0:7074:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790920323.278055:0:7074:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a49158445469f79 00000100:00080000:3.0:1790920323.278072:0:7074:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790920323.278090:0:7074:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88eb3f49f800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:3.0:1790920323.278143:0:7074:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb05840e00 x1877915972152064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790920323.278173:0:7074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790920323.278247:0:7074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920323.278251:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920323.278253:0:7074:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790920323.278256:0:7074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920323.278260:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920323.278262:0:7074:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790920323.278265:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790920323.278267:0:7074:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790920323.278298:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7074:1877915972152192:0@lo:502: 00000100:00100000:3.0:1790920323.278379:0:7074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920323.278422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152192 00000100:00100000:3.0:1790920323.278429:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152192 00000100:00100000:3.0:1790920323.278469:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790920323.278480:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7074:x1877915972152192:12345-0@lo:502: 00000100:00100000:1.0:1790920323.278615:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972152064:0@lo:8: 00000100:00100000:1.0:1790920323.278655:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920323.278870:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152064 00000100:00100000:0.0:1790920323.278874:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152064 00000100:00100000:0.0:1790920323.278905:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920323.278910:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1877915972152064:12345-0@lo:8: 00010000:00080000:0.0:1790920323.278935:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1790920323.278967:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a49158445469f80 00002000:00100000:0.0:1790920323.279000:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88eb3f9ae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790920323.279005:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1790920323.279010:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790920323.279134:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790920323.279271:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790920323.279298:0:6688:0:(import.c:65:import_set_state_nolock()) ffff88eb3f9ac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920323.279357:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1877915972152064:12345-0@lo:8: Request processed in 445us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920323.279364:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790920323.279413:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb05840e00 x1877915972152064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790920333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920323.279424:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790920323.279432:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790920323.279441:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790920323.279448:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790920323.279450:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f49f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790920323.279464:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790920323.279469:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972152064:0@lo:8: 00000100:00100000:2.0:1790920323.279601:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972152448:0@lo:400: 00000100:00100000:2.0:1790920323.279644:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.279668:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790920323.279673:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972152320:0@lo:400: 00000100:00100000:2.0:1790920323.279692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.279718:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152448 00000100:00100000:2.0:1790920323.279722:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152448 00000100:00100000:2.0:1790920323.279783:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152320 00000100:00100000:2.0:1790920323.279786:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152320 00000100:00100000:2.0:1790920323.279801:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920323.279808:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972152448:12345-0@lo:400: 00000100:00100000:2.0:1790920323.279851:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972152448:12345-0@lo:400: Request processed in 43us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.279857:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920323.279870:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790920323.279874:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972152320:12345-0@lo:400: 00000100:00100000:2.0:1790920323.279910:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972152320:12345-0@lo:400: Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.279915:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1790920323.279934:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790920323.279954:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb05629c00 x1877915972152320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920323.279963:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972152320:0@lo:400: 00010000:00080000:2.0:1790920323.279973:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb05629880 x1877915972152448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920323.279980:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972152448:0@lo:400: 00000100:00100000:3.0:1790920323.281898:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7074:x1877915972152192:12345-0@lo:502: Request processed in 3402us (3501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920323.281912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790920323.281982:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920323.282004:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7074:1877915972152192:0@lo:502: 00000020:01000000:3.0:1790920323.282037:0:7074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920323.282045:0:7074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920323.282047:0:7074:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790920323.282054:0:7074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:0.0:1790920323.282589:0:7077:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790920323.282793:0:7077:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 165449044730ns, next at 0ns, rc = 0 00000020:01000000:1.0:1790920323.283742:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790920323.283790:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790920323.283803:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.283818:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920323.283829:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790920323.283832:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88eb05f10000 from 1 10000000:01000000:1.0:1790920323.283836:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790920323.283876:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.283894:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920323.283906:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920323.283931:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972152576:0@lo:101: 00000100:00100000:1.0:1790920323.284001:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920323.284054:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.285200:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152576 00000100:00100000:2.0:1790920323.285214:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152576 00000100:00100000:2.0:1790920323.285272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790920323.285283:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972152576:12345-0@lo:101: 00010000:00010000:2.0:1790920323.285301:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920323.285320:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469f87 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.285348:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469f87 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.285378:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f87 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.285388:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139d400, rc 0) 00000100:00100000:2.0:1790920323.285453:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972152576:12345-0@lo:101: Request processed in 172us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.285461:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790920323.287684:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972152576:0@lo:101: 00010000:00010000:2.0:1790920323.287716:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.287729:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920323.287831:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972152704:0@lo:501: 00000100:00100000:2.0:1790920323.287906:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.287945:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920323.288048:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152704 00000100:00100000:3.0:1790920323.288057:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152704 00000100:00100000:3.0:1790920323.288109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790920323.288118:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972152704:12345-0@lo:501: 00000100:00100000:3.0:1790920323.288333:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972152704:12345-0@lo:501: Request processed in 215us (427us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790920323.288341:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790920323.289087:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972152704:0@lo:501: 10000000:01000000:2.0:1790920323.289123:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790920323.289133:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920323.289145:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920323.317010:0:7078:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790920323.317063:0:7078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972152960:0@lo:7: 00000100:00100000:2.0:1790920323.317151:0:7078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.317215:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152960 00000100:00100000:2.0:1790920323.317224:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152960 00000100:00100000:2.0:1790920323.317301:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790920323.317313:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7078:x1877915972152960:12345-0@lo:7: 00000100:00100000:3.0:1790920323.320947:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972152832:0@lo:13: 00000100:00100000:3.0:1790920323.321037:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920323.321377:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972152832 00000100:00100000:1.0:1790920323.321388:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972152832 00000100:00100000:1.0:1790920323.321441:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920323.321451:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877915972152832:12345-0@lo:13: 00000100:00100000:0.0:1790920323.322245:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1790920323.322259:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1790920323.322600:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790920323.322711:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877915972152832:12345-0@lo:13: Request processed in 1260us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920323.322728:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790920323.322859:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb10a28e00 x1877915972152832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920323.322894:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972152832:0@lo:13: 00000100:00080000:3.0:1790920323.323793:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920323.323819:0:7078:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cddf00 going to sleep for 11 seconds 00002000:00080000:2.0:1790920323.326995:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1790920323.327009:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790920323.327146:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7078:x1877915972152960:12345-0@lo:7: Request processed in 9828us (9988us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920323.327159:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790920323.327236:0:7078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb10a2ad80 x1877915972152960/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790920339 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920323.327255:0:7078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972152960:0@lo:7: 00000004:00080000:2.0:1790920323.327270:0:7078:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790920323.327320:0:7078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972153088:0@lo:5: 00000100:00100000:2.0:1790920323.327357:0:7078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.327394:0:7078:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.327417:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153088 00000100:00100000:2.0:1790920323.327424:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153088 00000100:00100000:2.0:1790920323.327596:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790920323.327607:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7078:x1877915972153088:12345-0@lo:5: 00002000:00080000:2.0:1790920323.327635:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790920323.327640:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790920323.327974:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7078:x1877915972153088:12345-0@lo:5: Request processed in 369us (616us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790920323.327981:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790920323.328022:0:7078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb10a2ad80 x1877915972153088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790920339 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920323.328037:0:7078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972153088:0@lo:5: 00000004:00080000:2.0:1790920323.328048:0:7078:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790920323.328078:0:7078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972153216:0@lo:700: 00000100:00100000:2.0:1790920323.328104:0:7078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.328122:0:7078:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.328141:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153216 00000100:00100000:2.0:1790920323.328144:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153216 00000100:00100000:2.0:1790920323.328171:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920323.328178:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7078:x1877915972153216:12345-0@lo:700: 00000100:00100000:2.0:1790920323.328207:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1877915972153344:0@lo:700: 00000100:00100000:2.0:1790920323.328234:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.328249:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920323.328269:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153344 00000100:00100000:2.0:1790920323.328272:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153344 00000100:00100000:2.0:1790920323.328300:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920323.328305:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1877915972153344:12345-0@lo:700: 00000004:00080000:1.0:1790920323.347136:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1790920323.385465:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1790920323.396279:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1877915972153344:12345-0@lo:700: Request processed in 67962us (68032us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920323.396301:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790920323.398918:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb10a29c00 x1877915972153344/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790920339 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920323.398938:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1877915972153344:0@lo:700: 40000000:02000000:0.0:1790920323.398955:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1790920323.492435:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1790920323.492461:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1790920323.492636:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7078:x1877915972153216:12345-0@lo:700: Request processed in 164452us (164525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920323.492655:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790920323.492840:0:7078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb10a2b480 x1877915972153216/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790920339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920323.492855:0:7078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790920323.492889:0:7078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972153216:0@lo:700: 00000004:02000040:2.0:1790920323.544603:0:7078:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1790920323.550392:0:7078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972153472:0@lo:5: 00000100:00100000:2.0:1790920323.550479:0:7078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920323.550731:0:7078:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790920323.551451:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153472 00000100:00100000:0.0:1790920323.551461:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153472 00000100:00100000:0.0:1790920323.551638:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920323.551650:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7078:x1877915972153472:12345-0@lo:5: 00002000:00080000:3.0:1790920323.557676:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790920323.557707:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1790920323.561781:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7078:x1877915972153472:12345-0@lo:5: Request processed in 10094us (11263us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790920323.561796:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790920323.562027:0:7078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb10a2b480 x1877915972153472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790920339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920323.562048:0:7078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7078:1877915972153472:0@lo:5: 00000004:00080000:0.0:1790920323.562065:0:7078:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1790920324.140394:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920325.165305:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920326.185254:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920327.209216:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790920327.855047:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790920328.233180:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920328.298706:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972153728:0@lo:400: 00000100:00100000:1.0:1790920328.298825:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920328.298897:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920328.299005:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972153984:0@lo:400: 00000100:00100000:0.0:1790920328.299046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920328.299076:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920328.299082:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972153600:0@lo:400: 00000100:00100000:0.0:1790920328.299114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920328.299214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153600 00000100:00100000:3.0:1790920328.299225:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153600 00000100:00100000:3.0:1790920328.299290:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920328.299300:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3304:x1877915972153600:12345-0@lo:400: 00000100:00100000:3.0:1790920328.299366:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3304:x1877915972153600:12345-0@lo:400: Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920328.299374:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920328.299539:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972153600:0@lo:400: 00000100:00100000:1.0:1790920328.299596:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972153856:0@lo:400: 00000100:00100000:1.0:1790920328.299631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920328.299717:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153728 00000100:00100000:0.0:1790920328.299722:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153728 00000100:00100000:0.0:1790920328.299798:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153856 00000100:00100000:0.0:1790920328.299803:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153856 00000100:00100000:0.0:1790920328.299836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790920328.299843:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972153728:12345-0@lo:400: 00000100:00100000:0.0:1790920328.299886:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972153728:12345-0@lo:400: Request processed in 43us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920328.299892:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790920328.299986:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790920328.299995:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972153856:12345-0@lo:400: 00000100:00100000:0.0:1790920328.300025:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972153856:12345-0@lo:400: Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920328.300031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1790920328.300131:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790920328.300161:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447f100 x1877915972153856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920328.300174:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972153856:0@lo:400: 00010000:00080000:1.0:1790920328.300185:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447c700 x1877915972153728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920328.300195:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972153728:0@lo:400: 00000100:00100000:0.0:1790920328.301004:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972153984 00000100:00100000:0.0:1790920328.301013:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972153984 00000100:00100000:0.0:1790920328.301074:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920328.301083:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972153984:12345-0@lo:400: 00000100:00080000:1.0:1790920328.301174:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920328.306411:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972153984:12345-0@lo:400: Request processed in 5300us (7335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920328.306431:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790920328.306634:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447e300 x1877915972153984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920328.306650:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790920328.306673:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972153984:0@lo:400: 00000100:00100000:2.0:1790920328.818964:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972154112:0@lo:13: 00000100:00100000:2.0:1790920328.819081:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920328.820423:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972154112 00000100:00100000:1.0:1790920328.820437:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972154112 00000100:00100000:1.0:1790920328.820506:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920328.820518:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972154112:12345-0@lo:13: 00002000:00000024:1.0:1790920328.820569:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920328.820657:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972154112:12345-0@lo:13: Request processed in 140us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920328.820665:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790920328.820975:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447c700 x1877915972154112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920328.821000:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972154112:0@lo:13: 00010000:00010000:3.0:1790920329.257232:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920330.281433:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920331.308419:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920332.330310:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920333.358215:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920333.417231:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972154240:0@lo:400: 00000100:00100000:3.0:1790920333.417348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920333.417432:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790920333.417439:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972154368:0@lo:400: 00000100:00100000:3.0:1790920333.417490:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920333.417528:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972154496:0@lo:400: 00000100:00100000:3.0:1790920333.417551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920333.417571:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920333.417576:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972154624:0@lo:400: 00000100:00100000:3.0:1790920333.417600:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920333.417636:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972154240 00000100:00100000:3.0:1790920333.417646:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972154240 00000100:00100000:3.0:1790920333.417715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790920333.417725:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3306:x1877915972154240:12345-0@lo:400: 00000100:00100000:3.0:1790920333.417822:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3306:x1877915972154240:12345-0@lo:400: Request processed in 98us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920333.417830:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790920333.417875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972154368 00000100:00100000:3.0:1790920333.417879:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972154368 00000100:00100000:3.0:1790920333.417907:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972154496 00000100:00100000:3.0:1790920333.417910:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972154496 00000100:00100000:3.0:1790920333.417937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790920333.417942:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972154368:12345-0@lo:400: 00000100:00100000:3.0:1790920333.417973:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972154368:12345-0@lo:400: Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920333.417979:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790920333.417991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790920333.417997:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972154496:12345-0@lo:400: 00000100:00100000:3.0:1790920333.418027:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972154496:12345-0@lo:400: Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920333.418040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1790920333.418096:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447c000 x1877915972154496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920333.418113:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972154496:0@lo:400: 00010000:00080000:3.0:1790920333.418145:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447ed80 x1877915972154368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920333.418153:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972154368:0@lo:400: 00000100:00100000:3.0:1790920333.418161:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972154240:0@lo:400: 00000100:00100000:3.0:1790920333.418211:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972154624 00000100:00100000:3.0:1790920333.418215:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972154624 00000100:00100000:3.0:1790920333.418253:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790920333.418260:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972154624:12345-0@lo:400: 00000100:00100000:3.0:1790920333.418296:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972154624:12345-0@lo:400: Request processed in 38us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920333.418302:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790920333.418330:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447ce00 x1877915972154624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920333.418339:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972154624:0@lo:400: 00000100:00080000:0.0:1790920333.422148:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920333.422161:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920333.929869:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790920333.929911:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972154752:0@lo:13: 00000100:00100000:1.0:1790920333.930003:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920333.930081:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972154752 00000100:00100000:1.0:1790920333.930090:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972154752 00000100:00100000:1.0:1790920333.930145:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920333.930154:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972154752:12345-0@lo:13: 00002000:00000024:1.0:1790920333.930199:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920333.930654:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972154752:12345-0@lo:13: Request processed in 499us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920333.930664:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790920333.932032:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3447df80 x1877915972154752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920333.932058:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972154752:0@lo:13: 00010000:00010000:0.0:1790920334.377075:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790920334.452355:0:7631:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790920334.452360:0:7631:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790920334.452513:0:7631:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88eb3a4ce000 00000020:01000004:3.0:1790920334.452539:0:7631:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790920334.452555:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790920334.452573:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88eb41c04d40) 00000020:00000080:3.0:1790920334.452594:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790920334.483678:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790920334.484042:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790920334.514847:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790920334.520230:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790920334.520266:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790920334.520331:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790920334.520363:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790920334.520822:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790920334.520838:0:7631:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790920334.520850:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2a49158445469f9c 00000020:01000004:3.0:1790920334.520860:0:7631:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790920334.520886:0:7631:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790920334.520890:0:7631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790920334.520897:0:7631:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790920334.520920:0:7631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790920334.520924:0:7631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790920334.539947:0:7631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790920334.539997:0:7631:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.134@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790920334.540002:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790920334.540004:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790920334.540005:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920334.540006:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920334.540007:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920334.540008:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920334.540010:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920334.540011:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920334.540013:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920334.540014:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920334.540016:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920334.540020:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790920334.540022:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790920334.540024:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790920334.540025:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920334.540031:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920334.540031:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920334.540032:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920334.540033:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920334.540034:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920334.540035:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920334.540036:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920334.540036:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920334.540072:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790920334.540097:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972154880:0@lo:253: 00000100:00100000:2.0:1790920334.540264:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920334.540396:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920334.540452:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972154880 00000100:00100000:3.0:1790920334.540460:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972154880 00000100:00100000:3.0:1790920334.540554:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790920334.540566:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:7631:x1877915972154880:12345-0@lo:253: 20000000:01000000:3.0:1790920334.540604:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790920334.540609:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1790920334.540615:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1790920334.540619:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1790920334.541849:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920334.542089:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1790920334.542113:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1790920334.542166:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1790920334.542176:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1790920334.542210:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1790920334.542257:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790920334.542646:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790920334.542682:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:3.0:1790920334.542684:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790920334.542719:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790920334.542726:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790920334.542796:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790920334.542804:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:3.0:1790920334.542831:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1790920334.542839:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790920334.542862:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1790920334.542902:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1790920334.543903:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1790920334.543924:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:3.0:1790920334.543926:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:3.0:1790920334.543957:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1790920334.543963:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790920334.543987:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1790920334.543994:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:3.0:1790920334.544016:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1790920334.544023:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790920334.544058:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1790920334.544111:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1790920334.544129:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1790920334.544132:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1790920334.544139:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790920334.544140:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790920334.544143:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790920334.544169:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790920334.544172:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790920334.544211:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790920334.544214:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790920334.545004:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1790920334.545081:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1790920334.545119:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1790920334.545638:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1790920334.545708:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1790920334.545954:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1790920334.545970:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790920334.545973:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790920334.546548:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1790920334.546600:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1790920334.546647:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790920334.547157:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790920334.547204:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790920334.547282:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1790920334.547298:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790920334.547300:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790920334.547879:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1790920334.547927:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1790920334.547972:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1790920334.548249:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1790920334.548295:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1790920334.548329:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1790920334.548342:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790920334.548344:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790920334.548712:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790920334.549086:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790920334.549135:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790920334.549225:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1790920334.549246:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790920334.549271:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549294:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469eed expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549303:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f17 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549311:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f41 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549326:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f5d expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549333:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f87 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549341:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549397:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469f87 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549417:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469f87 expref: 16 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.549435:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155008:0@lo:104: 00000100:00100000:3.0:1790920334.549527:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790920334.549634:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469f5d expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549643:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469f5d expref: 16 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.549652:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155136:0@lo:104: 00010000:00010000:3.0:1790920334.549693:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469f41 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549702:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469f41 expref: 16 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.549722:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155264:0@lo:104: 00010000:00010000:3.0:1790920334.549889:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469f17 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549898:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469f17 expref: 16 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.549907:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155392:0@lo:104: 00010000:00010000:3.0:1790920334.549941:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469eed expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.549950:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469eed expref: 16 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.549958:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155520:0@lo:104: 00000100:00100000:3.0:1790920334.549978:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3fb14780 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.550061:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790920334.550082:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920334.550153:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920334.550216:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.550235:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155008 00000100:00100000:1.0:1790920334.550244:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155008 00000100:00100000:1.0:1790920334.550285:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155136 00000100:00100000:1.0:1790920334.550288:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155136 00000100:00100000:1.0:1790920334.550299:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155264 00000100:00100000:1.0:1790920334.550301:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155264 00000100:00100000:1.0:1790920334.550313:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920334.550321:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb180f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:5840:x1877915972155008:12345-0@lo:104: 00010000:00010000:1.0:1790920334.550345:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550426:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790920334.550432:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb180f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:5840:x1877915972155008:12345-0@lo:104: Request processed in 112us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.550440:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920334.550487:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920334.550493:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:5840:x1877915972155136:12345-0@lo:104: 00010000:00010000:1.0:1790920334.550501:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550538:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790920334.550543:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:5840:x1877915972155136:12345-0@lo:104: Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.550549:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920334.550561:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790920334.550567:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5840:x1877915972155264:12345-0@lo:104: 00010000:00010000:1.0:1790920334.550575:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550602:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790920334.550606:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5840:x1877915972155264:12345-0@lo:104: Request processed in 40us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.550612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790920334.550630:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790920334.550637:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550650:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029efa00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920334.550655:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550663:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920334.550683:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920334.550688:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920334.550720:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550727:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920334.550783:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550791:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a49158445469f87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550811:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790920334.550815:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550820:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421ce600 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920334.550823:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550842:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920334.550849:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920334.550855:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920334.550870:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550875:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920334.550893:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550900:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421ce600/0x2a49158445469f5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550911:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920334.550914:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550920:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029eea00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920334.550923:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550930:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920334.550937:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920334.550949:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920334.550964:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550970:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920334.550976:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550982:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb029eea00/0x2a49158445469f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.550995:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920334.550996:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920334.550998:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920334.551008:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920334.551021:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972155648:0@lo:103: 00000100:00100000:1.0:1790920334.551058:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.551089:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972155904:0@lo:103: 00000100:00100000:1.0:1790920334.551113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.551132:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790920334.551137:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972155776:0@lo:103: 00000100:00100000:1.0:1790920334.551157:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.551189:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155648 00000100:00100000:1.0:1790920334.551193:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155648 00010000:00010000:1.0:1790920334.551216:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f87 expref: 17 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920334.551231:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155904 00000100:00100000:1.0:1790920334.551242:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155904 00010000:00010000:1.0:1790920334.551256:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f41 expref: 18 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920334.551268:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155776 00000100:00100000:1.0:1790920334.551271:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155776 00010000:00010000:1.0:1790920334.551280:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f5d expref: 19 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920334.551293:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920334.551298:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972155648:12345-0@lo:103: 00010000:00010000:1.0:1790920334.551310:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920334.551315:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f87 expref: 19 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.551326:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469f87 expref: 19 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.551345:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920334.551377:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972155648:12345-0@lo:103: Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.551384:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920334.551400:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920334.551407:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:3305:x1877915972155904:12345-0@lo:103: 00010000:00010000:1.0:1790920334.551415:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920334.551419:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f41 expref: 18 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.551428:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469f41 expref: 18 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.551448:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920334.551478:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:3305:x1877915972155904:12345-0@lo:103: Request processed in 72us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.551485:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920334.551499:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790920334.551506:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:3305:x1877915972155776:12345-0@lo:103: 00010000:00010000:1.0:1790920334.551514:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920334.551519:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f5d expref: 17 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.551527:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469f5d expref: 17 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.551536:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920334.551557:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:3305:x1877915972155776:12345-0@lo:103: Request processed in 52us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.551563:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790920334.551609:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972155648:0@lo:103: 00000100:00100000:1.0:1790920334.551638:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972155776:0@lo:103: 00000100:00100000:1.0:1790920334.551645:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972155904:0@lo:103: 00010000:00010000:0.0:1790920334.553031:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920334.554382:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139d400/0x2a49158445469f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469f87 expref: 16 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.554406:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155008:0@lo:104: 00010000:00010000:3.0:1790920334.554420:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139c800/0x2a49158445469f64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469f5d expref: 15 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.554429:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155136:0@lo:104: 00010000:00010000:3.0:1790920334.554438:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139ca00/0x2a49158445469f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469f41 expref: 14 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.554473:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155264:0@lo:104: 00000100:00100000:2.0:1790920334.555177:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.555259:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155392 00000100:00100000:1.0:1790920334.555271:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155392 00000100:00100000:1.0:1790920334.555329:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972155520 00000100:00100000:1.0:1790920334.555332:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972155520 00000100:00100000:1.0:1790920334.555349:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790920334.555362:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:5840:x1877915972155392:12345-0@lo:104: 00010000:00010000:1.0:1790920334.555394:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555549:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790920334.555556:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:5840:x1877915972155392:12345-0@lo:104: Request processed in 198us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.555564:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790920334.555599:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790920334.555608:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5840:x1877915972155520:12345-0@lo:104: 00010000:00010000:1.0:1790920334.555617:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555662:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790920334.555680:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5840:x1877915972155520:12345-0@lo:104: Request processed in 74us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.555687:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790920334.555708:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790920334.555716:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555725:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030800 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920334.555730:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555740:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920334.555774:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920334.555788:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920334.555843:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555851:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920334.555871:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555880:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f1e expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555896:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920334.555900:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555906:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029ef200 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920334.555909:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555916:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920334.555924:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920334.555930:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920334.555958:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555965:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920334.555978:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.555985:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb029ef200/0x2a49158445469eed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469ef4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556003:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920334.556005:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920334.556006:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920334.556025:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972156032:0@lo:103: 00000100:00100000:1.0:1790920334.556075:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.556122:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920334.556128:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972156160:0@lo:103: 00000100:00100000:1.0:1790920334.556150:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.556180:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156032 00000100:00100000:1.0:1790920334.556185:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156032 00010000:00010000:1.0:1790920334.556205:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f17 expref: 14 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920334.556228:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156160 00000100:00100000:1.0:1790920334.556231:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156160 00010000:00010000:1.0:1790920334.556245:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469eed expref: 15 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920334.556258:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790920334.556264:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:3306:x1877915972156032:12345-0@lo:103: 00010000:00010000:1.0:1790920334.556275:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920334.556280:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f17 expref: 15 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556306:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469f17 expref: 15 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556328:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920334.556360:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:3306:x1877915972156032:12345-0@lo:103: Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.556367:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790920334.556382:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790920334.556388:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:3306:x1877915972156160:12345-0@lo:103: 00010000:00010000:1.0:1790920334.556396:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920334.556401:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469eed expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556410:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469eed expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556423:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556433:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556450:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556458:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556465:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556481:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556487:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421ce000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920334.556491:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556500:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556510:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.556521:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920334.556546:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:3306:x1877915972156160:12345-0@lo:103: Request processed in 159us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.556553:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790920334.556613:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972156160:0@lo:103: 00000100:00100000:1.0:1790920334.556622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972156032:0@lo:103: 00010000:00010000:0.0:1790920334.556817:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920334.557319:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029ef400/0x2a49158445469f1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469f17 expref: 13 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.557336:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155392:0@lo:104: 00010000:00010000:3.0:1790920334.557349:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421cfc00/0x2a49158445469ef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469eed expref: 12 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.557362:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1877915972155520:0@lo:104: 00010000:00010000:3.0:1790920334.557386:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.557397:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.557403:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.557409:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421ce000/0x2a49158445469fa3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790920334.557427:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790920334.599558:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:7631:x1877915972154880:12345-0@lo:253: Request processed in 58977us (59278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.599579:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790920334.599733:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972154880:0@lo:253: 10000000:01000000:2.0:1790920334.599772:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790920334.599777:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790920334.599779:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790920334.599781:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920334.599782:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1790920334.599784:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920334.599785:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920334.599786:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920334.599788:0:7631:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790920334.599789:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920334.599790:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790920334.599817:0:7631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88eb3a4ce000 from lustre-OST0001 10000000:01000000:2.0:1790920334.599847:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790920334.599850:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790920334.599859:0:7631:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88eb05f10000 local copy 10000000:01000000:2.0:1790920334.599865:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790920334.599917:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920334.600025:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920334.600038:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920334.600064:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156288:0@lo:101: 00000100:00100000:2.0:1790920334.600115:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920334.600162:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920334.600228:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156288 00000100:00100000:3.0:1790920334.600237:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156288 00000100:00100000:3.0:1790920334.600381:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790920334.600398:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+11:7631:x1877915972156288:12345-0@lo:101: 00010000:00010000:3.0:1790920334.600416:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920334.600432:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421ce000/0x2a49158445469fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469faa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.600460:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421ce000/0x2a49158445469fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469faa expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.600471:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421ce000/0x2a49158445469fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469faa expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.600481:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421ce000, rc 0) 00000100:00100000:3.0:1790920334.600576:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:7631:x1877915972156288:12345-0@lo:101: Request processed in 179us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.600582:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790920334.600699:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156288:0@lo:101: 00010000:00010000:0.0:1790920334.600715:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.600724:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920334.601062:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156416:0@lo:501: 00000100:00100000:0.0:1790920334.601099:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.601171:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee300 going to sleep for 11 seconds 00000100:00100000:3.0:1790920334.601213:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156416 00000100:00100000:3.0:1790920334.601217:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156416 00000100:00100000:3.0:1790920334.601356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790920334.601365:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:7631:x1877915972156416:12345-0@lo:501: 00000100:00100000:3.0:1790920334.601620:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:7631:x1877915972156416:12345-0@lo:501: Request processed in 256us (519us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790920334.601628:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790920334.601706:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156416:0@lo:501: 10000000:01000000:0.0:1790920334.601723:0:7631:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790920334.601781:0:7631:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790920334.601790:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.601800:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.601808:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.602053:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790920334.602081:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88eb3a4ce000 10000000:01000000:0.0:1790920334.602087:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790920334.602094:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790920334.602097:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790920334.602103:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790920334.602107:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790920334.602135:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.602145:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.602154:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920334.602170:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156544:0@lo:101: 00000100:00100000:0.0:1790920334.602204:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.602237:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee240 going to sleep for 11 seconds 00000100:00100000:3.0:1790920334.602305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156544 00000100:00100000:3.0:1790920334.602310:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156544 00000100:00100000:3.0:1790920334.602346:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790920334.602354:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:7631:x1877915972156544:12345-0@lo:101: 00010000:00010000:3.0:1790920334.602363:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920334.602376:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469fb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.602408:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469fb8 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.602418:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469fb8 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.602426:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421cfc00, rc 0) 00000100:00100000:3.0:1790920334.602462:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972156544:12345-0@lo:101: Request processed in 110us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.602468:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790920334.602545:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156544:0@lo:101: 00010000:00010000:0.0:1790920334.602560:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.602568:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920334.602635:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156672:0@lo:501: 00000100:00100000:0.0:1790920334.602688:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.602710:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee240 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.602772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156672 00000100:00100000:2.0:1790920334.602777:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156672 00000100:00100000:2.0:1790920334.602813:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790920334.602820:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972156672:12345-0@lo:501: 00000100:00100000:2.0:1790920334.603144:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972156672:12345-0@lo:501: Request processed in 323us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.603152:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790920334.603234:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156672:0@lo:501: 00000100:00100000:0.0:1790920334.603264:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156800:0@lo:503: 00000100:00100000:0.0:1790920334.603311:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.603345:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee240 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.603478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156800 00000100:00100000:2.0:1790920334.603484:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156800 00000100:00100000:2.0:1790920334.603513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790920334.603521:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972156800:12345-0@lo:503: 00000100:00100000:2.0:1790920334.603702:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972156800:12345-0@lo:503: Request processed in 180us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.603709:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790920334.603878:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156800:0@lo:503: 00000040:00080000:0.0:1790920334.608154:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790920334.608348:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156928:0@lo:502: 00000100:00100000:0.0:1790920334.608488:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.608543:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee240 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.608688:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972156928 00000100:00100000:2.0:1790920334.608696:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972156928 00000100:00100000:2.0:1790920334.608789:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790920334.608800:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972156928:12345-0@lo:502: 00000100:00100000:2.0:1790920334.609237:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972156928:12345-0@lo:502: Request processed in 438us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.609246:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790920334.609456:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972156928:0@lo:502: 00000040:00080000:0.0:1790920334.609853:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790920334.609910:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790920334.610027:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790920334.610087:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790920334.610127:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790920334.610164:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790920334.610206:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157056:0@lo:502: 00000100:00100000:0.0:1790920334.610259:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.610465:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee240 going to sleep for 11 seconds 00010000:00010000:1.0:1790920334.613779:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920334.613801:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.613816:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ae00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920334.613821:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.613834:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920334.613867:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920334.613874:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920334.613950:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.613957:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920334.614000:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.614009:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb3f56ae00/0x2a49158445469faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2a49158445469fb1 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.614032:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920334.614034:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920334.614036:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920334.614171:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790920334.614209:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972157184:0@lo:103: 00000100:00100000:2.0:1790920334.614303:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.614860:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157184 00000100:00100000:1.0:1790920334.614868:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157184 00000100:00100000:1.0:1790920334.614952:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920334.614962:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:3305:x1877915972157184:12345-0@lo:103: 00010000:00010000:1.0:1790920334.614980:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920334.614998:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421ce000/0x2a49158445469fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a49158445469faa expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.615016:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920334.615075:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3305:x1877915972157184:12345-0@lo:103: Request processed in 114us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.615084:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790920334.615533:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972157184:0@lo:103: 00000100:00100000:3.0:1790920334.615741:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157056 00000100:00100000:3.0:1790920334.615767:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157056 00000100:00100000:3.0:1790920334.615815:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790920334.615824:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:7631:x1877915972157056:12345-0@lo:502: 00000100:00100000:1.0:1790920334.616610:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157056:0@lo:502: 00000040:00080000:1.0:1790920334.616857:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790920334.616880:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:3.0:1790920334.617011:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:7631:x1877915972157056:12345-0@lo:502: Request processed in 1187us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.617021:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000020:01000000:1.0:1790920334.619012:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790920334.619027:0:7637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790920334.619034:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920334.619037:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790920334.619045:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790920334.619081:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88eb41feb380) 00000020:00000080:1.0:1790920334.619114:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790920334.619121:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790920334.619266:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb3a4ce000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790920334.619405:0:7637:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790920334.619416:0:7637:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2a49158445469fcd 00010000:00010000:2.0:1790920334.626173:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1790920334.627435:0:7637:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1790920334.632447:0:7637:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790920334.633731:0:7637:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1790920334.640657:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790920334.642137:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790920334.645181:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790920334.645455:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920334.645467:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920334.645469:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790920334.645475:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790920334.645491:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920334.645493:0:7637:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790920334.645497:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790920334.645500:0:7637:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790920334.645580:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920334.645584:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920334.645585:0:7637:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790920334.645589:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790920334.649249:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1790920334.649324:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790920334.649357:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.649373:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920334.649408:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3a4ce000 from 1 10000000:01000000:0.0:1790920334.649411:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920334.649464:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.649479:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.649492:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920334.649521:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157312:0@lo:101: 00000100:00100000:0.0:1790920334.649608:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.649654:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.649942:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157312 00000100:00100000:2.0:1790920334.649951:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157312 00000100:00100000:2.0:1790920334.650004:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790920334.650016:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:7631:x1877915972157312:12345-0@lo:101: 00010000:00010000:2.0:1790920334.650045:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920334.650060:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469fd4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920334.650091:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469fd4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920334.650104:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469fd4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920334.650115:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a800, rc 0) 00000100:00100000:2.0:1790920334.650164:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157312:12345-0@lo:101: Request processed in 151us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.650171:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790920334.650602:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157312:0@lo:101: 00010000:00010000:0.0:1790920334.650624:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.650633:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920334.650813:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157440:0@lo:501: 00000100:00100000:0.0:1790920334.650849:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.650880:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.651785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157440 00000100:00100000:2.0:1790920334.651793:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157440 00000100:00100000:2.0:1790920334.651834:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790920334.651843:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157440:12345-0@lo:501: 00000100:00100000:2.0:1790920334.652778:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157440:12345-0@lo:501: Request processed in 932us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.652789:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790920334.652857:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157440:0@lo:501: 00000100:00100000:2.0:1790920334.654123:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157568:0@lo:503: 00000100:00100000:2.0:1790920334.654703:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920334.656423:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920334.656708:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157568 00000100:00100000:0.0:1790920334.656720:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157568 00000100:00100000:0.0:1790920334.656808:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790920334.656818:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157568:12345-0@lo:503: 00000100:00100000:0.0:1790920334.657932:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157568:12345-0@lo:503: Request processed in 1111us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920334.657943:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790920334.658180:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157568:0@lo:503: 00000040:00080000:3.0:1790920334.659093:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790920334.659435:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157696:0@lo:502: 00000100:00100000:3.0:1790920334.659615:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920334.659732:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f42900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920334.659825:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157696 00000100:00100000:0.0:1790920334.659835:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157696 00000100:00100000:0.0:1790920334.660041:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790920334.660054:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157696:12345-0@lo:502: 00000100:00100000:0.0:1790920334.661591:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157696:12345-0@lo:502: Request processed in 1532us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920334.661605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790920334.662848:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157696:0@lo:502: 00000040:00080000:3.0:1790920334.663309:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790920334.663383:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790920334.663432:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157824:0@lo:502: 00000100:00100000:3.0:1790920334.663526:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920334.663588:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f42900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920334.663619:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157824 00000100:00100000:0.0:1790920334.663632:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157824 00000100:00100000:0.0:1790920334.663701:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790920334.663711:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157824:12345-0@lo:502: 00000100:00100000:0.0:1790920334.663996:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157824:12345-0@lo:502: Request processed in 285us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920334.664003:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790920334.664087:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157824:0@lo:502: 00000040:00080000:3.0:1790920334.664188:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790920334.664199:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790920334.666720:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920334.666739:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920334.666742:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790920334.666903:0:7641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb3a4ce000 00000020:00000080:3.0:1790920334.666906:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790920334.666931:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920334.666935:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920334.666946:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790920334.666951:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790920334.669293:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790920334.669421:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790920334.669494:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.669512:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920334.669578:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790920334.669582:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88eb3a4ce000 10000000:01000000:0.0:1790920334.669586:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88eb3a4ce000 10000000:01000000:0.0:1790920334.669610:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790920334.669618:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb3a4ce000 from 1 10000000:01000000:0.0:1790920334.669620:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790920334.669675:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.669685:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.669698:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920334.669727:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157952:0@lo:101: 00000100:00100000:0.0:1790920334.669844:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.669907:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feed80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920334.671344:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972157952 00000100:00100000:1.0:1790920334.671363:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972157952 00000100:00100000:1.0:1790920334.671441:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790920334.671453:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972157952:12345-0@lo:101: 00010000:00010000:1.0:1790920334.671472:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920334.671493:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a49158445469fe2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.671525:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a49158445469fe2 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.671538:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469fe2 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.671548:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029ef200, rc 0) 00000100:00100000:1.0:1790920334.671639:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972157952:12345-0@lo:101: Request processed in 189us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920334.671680:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790920334.672046:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972157952:0@lo:101: 00010000:00010000:0.0:1790920334.672071:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.672082:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920334.672218:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158080:0@lo:501: 00000100:00100000:0.0:1790920334.672261:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.672300:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.672494:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158080 00000100:00100000:2.0:1790920334.672508:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158080 00000100:00100000:2.0:1790920334.672553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790920334.672562:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158080:12345-0@lo:501: 00000100:00100000:2.0:1790920334.672859:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158080:12345-0@lo:501: Request processed in 297us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.672868:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790920334.673089:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158080:0@lo:501: 00000100:00100000:0.0:1790920334.673139:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158208:0@lo:503: 00000100:00100000:0.0:1790920334.673201:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920334.673363:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158208 00000100:00100000:2.0:1790920334.673370:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158208 00000100:00100000:2.0:1790920334.673436:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790920334.673454:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158208:12345-0@lo:503: 00000100:00100000:2.0:1790920334.673888:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158208:12345-0@lo:503: Request processed in 425us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.673900:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790920334.675195:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790920334.675300:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158208:0@lo:503: 00000040:00080000:0.0:1790920334.676558:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790920334.676683:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158336:0@lo:502: 00000100:00100000:0.0:1790920334.677003:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.677104:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.677168:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158336 00000100:00100000:2.0:1790920334.677178:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158336 00000100:00100000:2.0:1790920334.677337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790920334.677349:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158336:12345-0@lo:502: 00000100:00100000:2.0:1790920334.677608:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158336:12345-0@lo:502: Request processed in 261us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.677616:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790920334.677843:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158336:0@lo:502: 00000040:00080000:0.0:1790920334.678404:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790920334.678457:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790920334.678486:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790920334.678578:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790920334.678622:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790920334.678685:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790920334.678729:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790920334.678794:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790920334.679020:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790920334.679062:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790920334.679133:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790920334.679186:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790920334.679291:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790920334.679525:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790920334.680122:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790920334.680346:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790920334.680494:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790920334.680684:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790920334.680717:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790920334.680797:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790920334.681025:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790920334.681063:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790920334.681091:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790920334.681134:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790920334.681176:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790920334.681202:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790920334.681312:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790920334.681341:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1790920334.681373:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790920334.681497:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1790920334.681636:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1790920334.683530:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1790920334.683568:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1790920334.683626:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1790920334.683654:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1790920334.683733:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1790920334.683969:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1790920334.684028:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158464:0@lo:502: 00000100:00100000:0.0:1790920334.684109:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.684192:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.684303:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158464 00000100:00100000:2.0:1790920334.684316:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158464 00000100:00100000:2.0:1790920334.684415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790920334.684427:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158464:12345-0@lo:502: 00000100:00100000:2.0:1790920334.684730:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158464:12345-0@lo:502: Request processed in 303us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920334.684737:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790920334.685353:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158464:0@lo:502: 00000040:00080000:0.0:1790920334.685466:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1790920334.685477:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790920334.687100:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790920334.687133:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88eb18010000) 00000020:00000080:0.0:1790920334.687159:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1790920334.687388:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb3a4ce000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790920334.687393:0:7642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb3a4ce000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790920334.687396:0:7642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb3a4ce000 3 00010000:00080000:0.0:1790920334.687430:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb3f97a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.134@tcp at head 00010000:00010000:0.0:1790920334.690334:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790920334.690611:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790920334.690653:0:7642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790920334.690679:0:7642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2a49158445469ff7 00000100:00080000:0.0:1790920334.690700:0:7642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790920334.690714:0:7642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88eb3f97a000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1790920334.690785:0:7642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb0562ad80 x1877915972158592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790920334.690809:0:7642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790920334.690972:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1877915972158592:0@lo:38: 00000100:00100000:1.0:1790920334.691053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.691182:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158592 00000100:00100000:0.0:1790920334.691191:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158592 00000100:00100000:0.0:1790920334.691241:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920334.691252:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1877915972158592:12345-0@lo:38: 00010000:00080000:0.0:1790920334.691295:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:0.0:1790920334.691334:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2a49158445469ffe 00000004:00100000:0.0:1790920334.691351:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790920334.691384:0:5846:0:(import.c:65:import_set_state_nolock()) ffff88eb3f979800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920334.691440:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877915972158592:12345-0@lo:38: Request processed in 188us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920334.691447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790920334.691493:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb0562ad80 x1877915972158592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790920344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920334.691503:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790920334.691511:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1790920334.691520:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790920334.691525:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790920334.691527:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f97a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790920334.691532:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1877915972158592:0@lo:38: 00000100:00100000:3.0:1790920334.692375:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972158848:0@lo:400: 00000100:00100000:3.0:1790920334.692421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920334.692459:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158848 00000100:00100000:3.0:1790920334.692464:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158848 00000100:00100000:3.0:1790920334.692501:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790920334.692509:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972158848:12345-0@lo:400: 00000100:00100000:3.0:1790920334.692551:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972158848:12345-0@lo:400: Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.692557:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790920334.692586:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb05841880 x1877915972158848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920334.692598:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972158848:0@lo:400: 00000100:00100000:1.0:1790920334.692672:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920334.692683:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972158720:0@lo:400: 00000100:00100000:1.0:1790920334.692709:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920334.692804:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158720 00000100:00100000:3.0:1790920334.692809:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158720 00000100:00100000:3.0:1790920334.692889:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790920334.692897:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972158720:12345-0@lo:400: 00000100:00100000:3.0:1790920334.692944:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972158720:12345-0@lo:400: Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.692950:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000040:00080000:0.0:1790920334.703311:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1790920334.703718:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00010000:00080000:0.0:1790920334.704075:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb05843100 x1877915972158720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920334.704105:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972158720:0@lo:400: 10000000:01000000:2.0:1790920334.704186:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790920334.704218:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920334.704231:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790920334.704286:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790920334.704289:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790920334.704290:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920334.704292:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920334.704294:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920334.704296:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920334.704298:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920334.704299:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920334.704301:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920334.704303:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920334.704304:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790920334.704309:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1790920334.704312:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790920334.704314:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790920334.704315:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920334.704316:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920334.704317:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920334.704319:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920334.704320:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920334.704321:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920334.704322:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920334.704323:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920334.704324:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790920334.704356:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790920334.704375:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158976:0@lo:253: 00000100:00100000:2.0:1790920334.704455:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920334.704842:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1877915972159104:0@lo:901: 00000100:00100000:3.0:1790920334.704987:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920334.705054:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972159104 00000100:00100000:0.0:1790920334.705062:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972159104 00000100:00100000:0.0:1790920334.705123:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920334.705133:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1877915972159104:12345-0@lo:901: 00000100:00100000:0.0:1790920334.705541:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1877915972159104:12345-0@lo:901: Request processed in 409us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920334.705550:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790920334.705574:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920334.705638:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88ea028b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920334.705659:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972158976 00000100:00100000:2.0:1790920334.705682:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972158976 00000100:00100000:2.0:1790920334.705767:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790920334.705774:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7631:x1877915972158976:12345-0@lo:253: 20000000:01000000:2.0:1790920334.705797:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790920334.705811:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790920334.709223:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f42240 going to sleep for 11 seconds 00010000:00080000:3.0:1790920334.709301:0:7643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb05841880 x1877915972159104/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790920350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920334.709319:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1877915972159104:0@lo:901: 20000000:01000000:2.0:1790920334.733319:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790920334.733391:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790920334.734179:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790920334.734186:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790920334.734340:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.734365:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f4f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.734374:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.734425:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469f4f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.734441:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469f4f expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920334.734458:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877915972159232:0@lo:104: 00000100:00100000:1.0:1790920334.734530:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920334.734631:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41e5e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920334.734686:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972159232 00000100:00100000:0.0:1790920334.734695:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972159232 00000100:00100000:0.0:1790920334.734885:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790920334.734900:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5861:x1877915972159232:12345-0@lo:104: 00010000:00010000:0.0:1790920334.734919:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920334.735011:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790920334.735018:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:5861:x1877915972159232:12345-0@lo:104: Request processed in 123us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920334.735028:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1790920334.735092:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920334.735103:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735112:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cf400 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:3.0:1790920334.735118:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735129:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790920334.735138:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920334.735144:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790920334.735181:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735189:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790920334.735239:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a49158445469f4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735269:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920334.735272:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920334.735274:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920334.735290:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972159360:0@lo:103: 00000100:00100000:3.0:1790920334.735329:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920334.735389:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972159360 00000100:00100000:3.0:1790920334.735394:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972159360 00010000:00010000:3.0:1790920334.735416:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f4f expref: 15 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.735442:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790920334.735449:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:3307:x1877915972159360:12345-0@lo:103: 00010000:00010000:3.0:1790920334.735462:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920334.735468:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f4f expref: 15 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735481:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469f4f expref: 15 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735500:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735509:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790920334.735538:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005791395s 00010000:00010000:3.0:1790920334.735543:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735551:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735558:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735565:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735570:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029eea00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920334.735574:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735584:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735594:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920334.735606:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920334.735635:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:3307:x1877915972159360:12345-0@lo:103: Request processed in 187us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.735643:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790920334.735730:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972159360:0@lo:103: 00010000:00010000:1.0:1790920334.735896:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029efe00/0x2a49158445469f56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469f4f expref: 14 pid: 5840 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920334.735911:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1877915972159232:0@lo:104: 00010000:00010000:1.0:1790920334.735925:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.735943:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.735950:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920334.735956:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029eea00/0x2a4915844546a005 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920334.748920:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:7631:x1877915972158976:12345-0@lo:253: Request processed in 43134us (44452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920334.748953:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790920334.749063:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7631:1877915972158976:0@lo:253: 10000000:01000000:2.0:1790920334.749084:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790920334.749088:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790920334.749090:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790920334.749092:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920334.749093:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920334.749095:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920334.749096:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920334.749097:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920334.749099:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790920334.749101:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790920334.749102:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920334.749104:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790920334.749124:0:7631:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790920334.753317:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920334.753529:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790920334.753814:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920334.754001:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790920334.754259:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920334.754545:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790920334.757564:0:7631:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790920335.033977:0:7631:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790920335.033987:0:7631:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790920335.034023:0:7631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790920335.034088:0:7631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790920335.034104:0:7631:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790920335.034131:0:7631:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790920335.401433:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920336.427596:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920337.455541:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920338.474874:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920339.050091:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790920339.050140:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972159488:0@lo:13: 00000100:00100000:3.0:1790920339.050239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920339.050866:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972159488 00000100:00100000:0.0:1790920339.050876:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972159488 00000100:00080000:2.0:1790920339.050932:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920339.050973:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920339.050985:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972159488:12345-0@lo:13: 00002000:00000024:0.0:1790920339.051051:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920339.051134:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972159488:12345-0@lo:13: Request processed in 152us (895us total) trans 0 rc 0/0 00010000:00080000:3.0:1790920339.051223:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a28a80 x1877915972159488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920339.051245:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972159488:0@lo:13: 00000100:00100000:0.0:1790920339.051571:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790920339.501292:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790920340.072861:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790920340.072871:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb05888000 from 30 10000000:01000000:3.0:1790920340.072879:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790920340.072943:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.072956:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.072967:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920340.072999:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972159616:0@lo:101: 00000100:00100000:3.0:1790920340.073097:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.073167:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696240 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.073355:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972159616 00000100:00100000:1.0:1790920340.073365:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972159616 00000100:00100000:1.0:1790920340.073436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790920340.073446:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972159616:12345-0@lo:101: 00010000:00010000:1.0:1790920340.073462:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920340.073477:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a00c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.073508:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a00c expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.073521:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a00c expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.073532:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029eea00, rc 0) 00000100:00100000:1.0:1790920340.073587:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972159616:12345-0@lo:101: Request processed in 143us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920340.073595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790920340.073949:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972159872:0@lo:400: 00000100:00100000:3.0:1790920340.073987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.074025:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790920340.074031:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972160000:0@lo:400: 00000100:00100000:3.0:1790920340.074059:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.074094:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160000 00000100:00100000:3.0:1790920340.074098:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160000 00000100:00100000:3.0:1790920340.074131:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790920340.074138:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972160000:12345-0@lo:400: 00000100:00100000:3.0:1790920340.074177:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972160000:12345-0@lo:400: Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.074184:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790920340.074224:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562a300 x1877915972160000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920340.074239:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972160000:0@lo:400: 00000100:00100000:0.0:1790920340.074365:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972159872 00000100:00100000:0.0:1790920340.074369:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972159872 00000100:00100000:0.0:1790920340.074414:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790920340.074421:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972159872:12345-0@lo:400: 00000100:00100000:1.0:1790920340.074481:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972159744:0@lo:400: 00000100:00100000:2.0:1790920340.074602:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972160128:0@lo:400: 00000100:00100000:3.0:1790920340.074651:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972159616:0@lo:101: 00010000:00010000:3.0:1790920340.074676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.074687:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920340.074772:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160256:0@lo:501: 00000100:00100000:0.0:1790920340.075577:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972159872:12345-0@lo:400: Request processed in 1138us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.075587:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790920340.075778:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790920340.075910:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920340.076488:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972159744 00000100:00100000:1.0:1790920340.076501:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972159744 00000100:00100000:1.0:1790920340.076548:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790920340.076570:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972159744:12345-0@lo:400: 00000100:00100000:1.0:1790920340.076652:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972159744:12345-0@lo:400: Request processed in 95us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920340.076659:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1790920340.077154:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562ad80 x1877915972159744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920340.077173:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972159744:0@lo:400: 00010000:00080000:1.0:1790920340.077217:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05628000 x1877915972159872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920340.077227:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972159872:0@lo:400: 00000100:00100000:2.0:1790920340.085847:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.085990:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160128 00000100:00100000:0.0:1790920340.086001:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160128 00000100:00100000:3.0:1790920340.086041:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.086090:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790920340.086102:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972160128:12345-0@lo:400: 00000100:00100000:3.0:1790920340.086198:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160256 00000100:00080000:2.0:1790920340.086199:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920340.086231:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696240 going to sleep for 11 seconds 00000100:00100000:3.0:1790920340.086393:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160256 00000100:00100000:3.0:1790920340.086436:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790920340.086452:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972160256:12345-0@lo:501: 00000100:00100000:3.0:1790920340.087096:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972160256:12345-0@lo:501: Request processed in 642us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.087107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790920340.088477:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972160128:12345-0@lo:400: Request processed in 2369us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.088493:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790920340.088585:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629880 x1877915972160128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920340.088606:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972160128:0@lo:400: 00000100:00100000:2.0:1790920340.088903:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160256:0@lo:501: 00000100:00100000:2.0:1790920340.088972:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160384:0@lo:503: 00000100:00100000:2.0:1790920340.089035:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920340.089133:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41e5e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.089515:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160384 00000100:00100000:0.0:1790920340.089524:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160384 00000100:00100000:0.0:1790920340.089603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790920340.089624:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972160384:12345-0@lo:503: 00000100:00100000:0.0:1790920340.090090:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972160384:12345-0@lo:503: Request processed in 467us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.090099:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790920340.090445:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160384:0@lo:503: 00000100:00100000:1.0:1790920340.091867:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7922:1877915972160512:0@lo:502: 00000100:00100000:1.0:1790920340.091949:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.091999:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920340.092084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160512 00000100:00100000:3.0:1790920340.092092:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160512 00000100:00100000:3.0:1790920340.092145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790920340.092155:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7922:x1877915972160512:12345-0@lo:502: 00000100:00100000:3.0:1790920340.093764:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7922:x1877915972160512:12345-0@lo:502: Request processed in 1585us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.093779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790920340.094664:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7922:1877915972160512:0@lo:502: 00000100:00100000:1.0:1790920340.094782:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7922:1877915972160640:0@lo:502: 00000100:00100000:1.0:1790920340.094851:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.094901:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920340.095014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160640 00000100:00100000:3.0:1790920340.095023:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160640 00000100:00100000:3.0:1790920340.095086:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790920340.095098:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7922:x1877915972160640:12345-0@lo:502: 00000100:00100000:3.0:1790920340.097164:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:7922:x1877915972160640:12345-0@lo:502: Request processed in 2056us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.097180:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790920340.099022:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7922:1877915972160640:0@lo:502: 00000040:00080000:1.0:1790920340.099097:0:7922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790920340.099773:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790920340.099804:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790920340.099819:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.099833:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920340.099845:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790920340.099849:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790920340.099859:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790920340.099908:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.099917:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.099929:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920340.099954:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160768:0@lo:101: 00000100:00100000:3.0:1790920340.100028:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.100086:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696600 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.103323:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160768 00000100:00100000:0.0:1790920340.103348:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160768 00000100:00100000:0.0:1790920340.103423:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790920340.103434:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972160768:12345-0@lo:101: 00010000:00010000:0.0:1790920340.103454:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920340.103479:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a01a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920340.103515:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a01a expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920340.103528:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a01a expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920340.103539:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00030000, rc 0) 00000100:00100000:0.0:1790920340.103667:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972160768:12345-0@lo:101: Request processed in 234us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.103674:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790920340.103948:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160768:0@lo:101: 00010000:00010000:1.0:1790920340.103971:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.103982:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920340.104079:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160896:0@lo:501: 00000100:00100000:1.0:1790920340.104119:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.104158:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.104343:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972160896 00000100:00100000:0.0:1790920340.104349:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972160896 00000100:00100000:0.0:1790920340.104388:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790920340.104397:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972160896:12345-0@lo:501: 00000100:00100000:0.0:1790920340.109156:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972160896:12345-0@lo:501: Request processed in 4746us (5022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.109176:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790920340.109658:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972160896:0@lo:501: 00000100:00100000:1.0:1790920340.109731:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161024:0@lo:503: 00000100:00100000:1.0:1790920340.109820:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.109860:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920340.110070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161024 00000100:00100000:3.0:1790920340.110079:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161024 00000100:00100000:3.0:1790920340.110134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790920340.110144:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972161024:12345-0@lo:503: 00000100:00100000:3.0:1790920340.112798:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972161024:12345-0@lo:503: Request processed in 2640us (2963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.112816:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790920340.114490:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161024:0@lo:503: 00000100:00100000:3.0:1790920340.118808:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7923:1877915972161152:0@lo:502: 00000100:00100000:3.0:1790920340.118934:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.118980:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696540 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.119109:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161152 00000100:00100000:0.0:1790920340.119119:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161152 00000100:00100000:0.0:1790920340.119177:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790920340.119188:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7923:x1877915972161152:12345-0@lo:502: 00000100:00100000:0.0:1790920340.119548:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7923:x1877915972161152:12345-0@lo:502: Request processed in 359us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.119567:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790920340.119996:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7923:1877915972161152:0@lo:502: 00000020:01000000:3.0:1790920340.120037:0:7923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920340.120049:0:7923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920340.120052:0:7923:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790920340.120064:0:7923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790920340.120067:0:7923:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790920340.120108:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7923:1877915972161280:0@lo:502: 00000100:00100000:3.0:1790920340.120155:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.120195:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696540 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.121932:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161280 00000100:00100000:0.0:1790920340.121949:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161280 00000100:00100000:0.0:1790920340.122024:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790920340.122034:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7923:x1877915972161280:12345-0@lo:502: 00000100:00100000:0.0:1790920340.123007:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:7923:x1877915972161280:12345-0@lo:502: Request processed in 969us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.123018:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790920340.123147:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7923:1877915972161280:0@lo:502: 00000020:01000000:3.0:1790920340.123190:0:7923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920340.123199:0:7923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920340.123202:0:7923:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790920340.123213:0:7923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790920340.133161:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790920340.133211:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790920340.133227:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.133242:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920340.134467:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790920340.134476:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb09ba1000 from 30 10000000:01000000:3.0:1790920340.134482:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790920340.134543:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.135583:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.138670:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920340.138740:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161408:0@lo:101: 00000100:00100000:3.0:1790920340.138864:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.138930:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696540 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.141721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161408 00000100:00100000:1.0:1790920340.141766:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161408 00000100:00100000:1.0:1790920340.141852:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790920340.141865:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972161408:12345-0@lo:101: 00010000:00010000:1.0:1790920340.141898:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920340.141927:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a028 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.141963:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a028 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.141976:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a028 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.141986:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029efe00, rc 0) 00000100:00100000:1.0:1790920340.142106:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972161408:12345-0@lo:101: Request processed in 244us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920340.142114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790920340.142219:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161408:0@lo:101: 00010000:00010000:1.0:1790920340.142241:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.142253:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920340.142336:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161536:0@lo:501: 00000100:00100000:1.0:1790920340.142372:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.142406:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.142963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161536 00000100:00100000:0.0:1790920340.142971:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161536 00000100:00100000:0.0:1790920340.143009:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790920340.143017:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972161536:12345-0@lo:501: 00000100:00100000:0.0:1790920340.143381:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972161536:12345-0@lo:501: Request processed in 363us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.143390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790920340.143438:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161536:0@lo:501: 00000100:00100000:0.0:1790920340.143481:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161664:0@lo:503: 00000100:00100000:0.0:1790920340.143528:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.143554:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161664 00000100:00100000:0.0:1790920340.143572:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161664 00000100:00100000:0.0:1790920340.143596:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790920340.143611:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972161664:12345-0@lo:503: 00000100:00100000:0.0:1790920340.143783:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972161664:12345-0@lo:503: Request processed in 172us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.143791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790920340.143826:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.143838:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972161664:0@lo:503: 00000100:00100000:1.0:1790920340.149839:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7924:1877915972161792:0@lo:502: 00000100:00100000:1.0:1790920340.149969:0:7924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.150022:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839780 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.150863:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161792 00000100:00100000:1.0:1790920340.150890:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161792 00000100:00100000:1.0:1790920340.150952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790920340.150962:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:7924:x1877915972161792:12345-0@lo:502: 00000100:00100000:3.0:1790920340.153311:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:7924:x1877915972161792:12345-0@lo:502: Request processed in 2339us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.153331:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790920340.153411:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7924:1877915972161792:0@lo:502: 00000100:00100000:1.0:1790920340.153507:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7924:1877915972161920:0@lo:502: 00000100:00100000:1.0:1790920340.159547:0:7924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.159624:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839780 going to sleep for 11 seconds 00000100:00100000:2.0:1790920340.159692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972161920 00000100:00100000:2.0:1790920340.159703:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972161920 00000100:00100000:2.0:1790920340.159777:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790920340.159789:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:7924:x1877915972161920:12345-0@lo:502: 00000100:00100000:2.0:1790920340.161650:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:7924:x1877915972161920:12345-0@lo:502: Request processed in 1852us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920340.161667:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790920340.161835:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7924:1877915972161920:0@lo:502: 00000040:00080000:1.0:1790920340.161883:0:7924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790920340.163516:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790920340.163553:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790920340.163579:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.163595:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920340.163608:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790920340.163611:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb09ba1000 from 5 10000000:01000000:2.0:1790920340.163615:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790920340.163669:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.163700:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.163715:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920340.163739:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162048:0@lo:101: 00000100:00100000:2.0:1790920340.163848:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920340.163897:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41e5e000 going to sleep for 11 seconds 00000100:00100000:3.0:1790920340.163957:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162048 00000100:00100000:3.0:1790920340.163966:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162048 00000100:00100000:3.0:1790920340.164017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790920340.164028:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972162048:12345-0@lo:101: 00010000:00010000:3.0:1790920340.164053:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920340.164071:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421ce600/0x2a4915844546a03d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a036 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.164100:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421ce600/0x2a4915844546a03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a036 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.164113:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421ce600/0x2a4915844546a03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a036 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920340.164123:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421ce600, rc 0) 00000100:00100000:3.0:1790920340.164165:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972162048:12345-0@lo:101: Request processed in 140us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.164173:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790920340.165915:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162048:0@lo:101: 00010000:00010000:2.0:1790920340.165954:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.165968:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920340.166881:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162176:0@lo:256: 00000100:00100000:2.0:1790920340.166967:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920340.167016:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41e5e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.168515:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162176 00000100:00100000:1.0:1790920340.168535:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162176 00000100:00100000:1.0:1790920340.168627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790920340.168639:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972162176:12345-0@lo:256: 20000000:01000000:1.0:1790920340.168674:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790920340.168710:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790920340.168713:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790920340.168893:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972162176:12345-0@lo:256: Request processed in 256us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920340.168900:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790920340.169516:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162176:0@lo:256: 10000000:01000000:2.0:1790920340.169599:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790920340.169613:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.169627:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920340.169653:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790920340.169656:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1790920340.169660:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790920340.169699:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.169707:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.169718:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920340.169738:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162304:0@lo:101: 00000100:00100000:2.0:1790920340.169832:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920340.169870:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162304 00000100:00100000:2.0:1790920340.169875:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162304 00000100:00100000:2.0:1790920340.169910:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790920340.169917:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972162304:12345-0@lo:101: 00010000:00010000:2.0:1790920340.169930:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920340.169944:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a044 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.169970:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a044 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.169982:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a044 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.169992:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a200, rc 0) 00000100:00100000:2.0:1790920340.170023:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972162304:12345-0@lo:101: Request processed in 105us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920340.170030:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790920340.170087:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb059499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920340.170100:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162304:0@lo:101: 00010000:00010000:2.0:1790920340.170114:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.170137:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920340.170189:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162432:0@lo:501: 00000100:00100000:2.0:1790920340.172018:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920340.172259:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb059499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.179851:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162432 00000100:00100000:1.0:1790920340.179871:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162432 00000100:00100000:1.0:1790920340.179953:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790920340.179965:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972162432:12345-0@lo:501: 00000100:00100000:1.0:1790920340.180404:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972162432:12345-0@lo:501: Request processed in 440us (8393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920340.180411:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790920340.180864:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162432:0@lo:501: 00000100:00100000:2.0:1790920340.180924:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162560:0@lo:503: 00000100:00100000:2.0:1790920340.180978:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920340.181015:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb059499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.181087:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162560 00000100:00100000:1.0:1790920340.181093:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162560 00000100:00100000:1.0:1790920340.181137:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790920340.181144:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972162560:12345-0@lo:503: 00000100:00100000:1.0:1790920340.181989:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972162560:12345-0@lo:503: Request processed in 837us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920340.182001:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790920340.182819:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972162560:0@lo:503: 00000100:00100000:2.0:1790920340.184956:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7925:1877915972162688:0@lo:502: 00000100:00100000:3.0:1790920340.186076:0:7925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.186965:0:7925:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.187882:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162688 00000100:00100000:1.0:1790920340.187896:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162688 00000100:00100000:1.0:1790920340.187956:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790920340.187966:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:7925:x1877915972162688:12345-0@lo:502: 00000100:00100000:1.0:1790920340.188611:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:7925:x1877915972162688:12345-0@lo:502: Request processed in 644us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920340.188619:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790920340.189920:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7925:1877915972162688:0@lo:502: 00000020:01000000:3.0:1790920340.189980:0:7925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790920340.189991:0:7925:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790920340.190002:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920340.190005:0:7925:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790920340.190016:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790920340.190021:0:7925:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:3.0:1790920340.190053:0:7925:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790920340.190056:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790920340.190075:0:7925:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88eb41c03380) 00000020:00000080:3.0:1790920340.190104:0:7925:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1790920340.190110:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790920340.190806:0:7925:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790920340.190828:0:7925:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790920340.190838:0:7925:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546a059 00010000:00080000:3.0:1790920340.190881:0:7925:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb3a4fd000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:3.0:1790920340.193473:0:7925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1790920340.193955:0:7925:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790920340.193974:0:7925:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790920340.199023:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920340.199833:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920340.199916:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790920340.200007:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790920340.205609:0:7927:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920340.205621:0:7927:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790920340.210096:0:7925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790920340.210118:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790920340.210167:0:7925:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790920340.210198:0:7925:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a4915844546a060 00000100:00080000:0.0:1790920340.210212:0:7925:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790920340.210228:0:7925:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88eb3a4fd000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1790920340.210278:0:7925:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb05629880 x1877915972162816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790920340.210300:0:7925:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790920340.210357:0:7925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920340.210361:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920340.210364:0:7925:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790920340.210367:0:7925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920340.210371:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920340.210373:0:7925:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790920340.210376:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790920340.210378:0:7925:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790920340.210412:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7925:1877915972162944:0@lo:502: 00000100:00100000:0.0:1790920340.210516:0:7925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.210579:0:7925:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.210599:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972162816:0@lo:8: 00000100:00100000:0.0:1790920340.210635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.210702:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162816 00000100:00100000:0.0:1790920340.210711:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162816 00000100:00100000:0.0:1790920340.210743:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790920340.210767:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1877915972162816:12345-0@lo:8: 00010000:00080000:0.0:1790920340.210793:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:0.0:1790920340.210817:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a4915844546a067 00002000:00100000:0.0:1790920340.210834:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88eb3f49b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790920340.210839:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1790920340.210843:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790920340.210997:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790920340.211151:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790920340.211179:0:6690:0:(import.c:65:import_set_state_nolock()) ffff88eb3f49a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920340.211236:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1877915972162816:12345-0@lo:8: Request processed in 468us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.211243:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790920340.211280:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629880 x1877915972162816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790920350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920340.211290:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790920340.211299:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790920340.211307:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790920340.211311:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790920340.211314:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4fd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790920340.211332:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790920340.211337:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972162816:0@lo:8: 00000004:00080000:2.0:1790920340.211398:0:7927:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790920340.211577:0:7927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 182377829379ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790920340.211617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972162944 00000100:00100000:3.0:1790920340.211622:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972162944 00000100:00100000:3.0:1790920340.211663:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790920340.211670:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:7925:x1877915972162944:12345-0@lo:502: 00000100:00100000:3.0:1790920340.211912:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:7925:x1877915972162944:12345-0@lo:502: Request processed in 242us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.211919:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790920340.211961:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:7925:1877915972162944:0@lo:502: 00000020:01000000:0.0:1790920340.211993:0:7925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920340.212006:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920340.212008:0:7925:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790920340.212013:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1790920340.213941:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1790920340.213979:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790920340.213992:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.214007:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920340.214020:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790920340.214023:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88eb05f10000 from 1 10000000:01000000:1.0:1790920340.214026:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790920340.214073:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.214083:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.214110:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920340.214136:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972163072:0@lo:101: 00000100:00100000:1.0:1790920340.214212:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.214267:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920340.222294:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163072 00000100:00100000:2.0:1790920340.222392:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163072 00000100:00100000:2.0:1790920340.222484:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790920340.222495:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972163072:12345-0@lo:101: 00010000:00010000:2.0:1790920340.222517:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920340.222542:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a06e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.223437:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a06e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.223452:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a06e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920340.223463:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56bc00, rc 0) 00000100:00100000:2.0:1790920340.223583:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972163072:12345-0@lo:101: Request processed in 1090us (9371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920340.223591:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790920340.223837:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972163072:0@lo:101: 00010000:00010000:1.0:1790920340.223863:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.223874:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920340.223961:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972163200:0@lo:501: 00000100:00100000:1.0:1790920340.223997:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.224037:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920340.224229:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163200 00000100:00100000:2.0:1790920340.224236:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163200 00000100:00100000:2.0:1790920340.224274:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790920340.224283:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972163200:12345-0@lo:501: 00000100:00100000:2.0:1790920340.225502:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972163200:12345-0@lo:501: Request processed in 1214us (1498us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790920340.225515:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790920340.225705:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972163200:0@lo:501: 10000000:01000000:1.0:1790920340.225795:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790920340.225809:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920340.225820:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920340.334572:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1790920340.334606:0:7929:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790920340.334646:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163456:0@lo:7: 00000100:00100000:0.0:1790920340.334736:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.334817:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.334853:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163456 00000100:00100000:0.0:1790920340.334862:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163456 00000100:00100000:0.0:1790920340.334941:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790920340.334951:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7929:x1877915972163456:12345-0@lo:7: 00000100:00080000:2.0:1790920340.337179:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920340.337733:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972163328:0@lo:13: 00000100:00100000:3.0:1790920340.337846:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920340.337946:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163328 00000100:00100000:3.0:1790920340.337955:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163328 00000100:00100000:3.0:1790920340.338004:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790920340.338013:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877915972163328:12345-0@lo:13: 00002000:00000024:3.0:1790920340.338054:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1790920340.338102:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877915972163328:12345-0@lo:13: Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920340.338109:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790920340.338161:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629c00 x1877915972163328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920340.338259:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972163328:0@lo:13: 00002000:00080000:0.0:1790920340.350224:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1790920340.350236:0:6688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790920340.350359:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7929:x1877915972163456:12345-0@lo:7: Request processed in 15403us (15618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920340.350371:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790920340.350431:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629880 x1877915972163456/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790920356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920340.350448:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163456:0@lo:7: 00000004:00080000:0.0:1790920340.350466:0:7929:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790920340.350515:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163584:0@lo:5: 00000100:00100000:0.0:1790920340.350624:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.350679:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790920340.350702:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163584 00000100:00100000:0.0:1790920340.350710:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163584 00000100:00100000:0.0:1790920340.350787:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790920340.350797:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1877915972163584:12345-0@lo:5: 00002000:00080000:0.0:1790920340.350829:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790920340.350842:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790920340.351098:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7929:x1877915972163584:12345-0@lo:5: Request processed in 301us (473us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790920340.351105:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790920340.351135:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629880 x1877915972163584/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790920356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920340.351148:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163584:0@lo:5: 00000004:00080000:0.0:1790920340.351158:0:7929:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790920340.351184:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163712:0@lo:700: 00000100:00100000:0.0:1790920340.351210:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.351232:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.351612:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163712 00000100:00100000:1.0:1790920340.351625:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163712 00000100:00100000:1.0:1790920340.351670:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920340.351677:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7929:x1877915972163712:12345-0@lo:700: 00000100:00100000:1.0:1790920340.351713:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1877915972163840:0@lo:700: 00000100:00100000:1.0:1790920340.351766:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920340.351795:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05839d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920340.351816:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163840 00000100:00100000:1.0:1790920340.351820:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163840 00000100:00100000:1.0:1790920340.351849:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920340.351856:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1877915972163840:12345-0@lo:700: 00000004:00080000:3.0:1790920340.399513:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1790920340.455771:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790920340.467996:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1877915972163840:12345-0@lo:700: Request processed in 116126us (116215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920340.468013:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790920340.469420:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3447ea00 x1877915972163840/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790920356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920340.469443:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1877915972163840:0@lo:700: 40000000:02000000:1.0:1790920340.469461:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1790920340.527430:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790920340.629979:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1790920340.630016:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790920340.630816:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7929:x1877915972163712:12345-0@lo:700: Request processed in 279131us (279597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920340.630840:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790920340.630916:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562b480 x1877915972163712/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790920356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920340.630929:0:7929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790920340.630949:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163712:0@lo:700: 00000004:02000040:0.0:1790920340.689793:0:7929:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1790920340.694097:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163968:0@lo:5: 00000100:00100000:0.0:1790920340.694259:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920340.694425:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3b3ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1790920340.695080:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972163968 00000100:00100000:3.0:1790920340.695091:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972163968 00000100:00100000:3.0:1790920340.695168:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790920340.695180:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7929:x1877915972163968:12345-0@lo:5: 00002000:00080000:3.0:1790920340.701968:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790920340.701996:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1790920340.705926:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1877915972163968:12345-0@lo:5: Request processed in 10738us (11657us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790920340.705943:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790920340.706018:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629180 x1877915972163968/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790920356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920340.706040:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1877915972163968:0@lo:5: 00000004:00080000:0.0:1790920340.706059:0:7929:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1790920341.546514:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790920341.605230:0:7994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790920342.573993:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920343.595840:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920344.174681:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790920344.174722:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972164096:0@lo:13: 00000100:00100000:2.0:1790920344.174874:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920344.184957:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164096 00000100:00100000:1.0:1790920344.184982:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164096 00000100:00100000:1.0:1790920344.185110:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790920344.185124:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972164096:12345-0@lo:13: 00002000:00000024:1.0:1790920344.185440:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790920344.185519:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920344.185580:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972164096:12345-0@lo:13: Request processed in 459us (10705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920344.185588:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790920344.185810:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562b480 x1877915972164096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920344.185838:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972164096:0@lo:13: 00010000:00010000:2.0:1790920344.617207:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920345.643373:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920345.705385:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972164608:0@lo:400: 00000100:00100000:0.0:1790920345.705494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920345.705573:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790920345.705600:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972164224:0@lo:400: 00000100:00100000:0.0:1790920345.705633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920345.705660:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972164736:0@lo:400: 00000100:00100000:0.0:1790920345.705690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920345.705720:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972164352:0@lo:400: 00000100:00100000:0.0:1790920345.705783:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920345.705809:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972164864:0@lo:400: 00000100:00100000:0.0:1790920345.705833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920345.705853:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920345.705858:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972164480:0@lo:400: 00000100:00100000:0.0:1790920345.705879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920345.705912:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164608 00000100:00100000:0.0:1790920345.705922:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164608 00000100:00100000:0.0:1790920345.705967:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164864 00000100:00100000:0.0:1790920345.705970:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164864 00000100:00100000:0.0:1790920345.706001:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920345.706012:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972164608:12345-0@lo:400: 00000100:00100000:0.0:1790920345.706075:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972164608:12345-0@lo:400: Request processed in 65us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920345.706083:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920345.706101:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790920345.706108:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972164864:12345-0@lo:400: 00000100:00100000:0.0:1790920345.706141:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972164864:12345-0@lo:400: Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920345.706147:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790920345.706165:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164736 00000100:00100000:0.0:1790920345.706168:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164736 00000100:00100000:0.0:1790920345.706214:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164352 00000100:00100000:0.0:1790920345.706218:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164352 00000100:00100000:0.0:1790920345.706228:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164480 00000100:00100000:0.0:1790920345.706230:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164480 00000100:00100000:0.0:1790920345.706245:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790920345.706251:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972164736:12345-0@lo:400: 00000100:00100000:0.0:1790920345.706281:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972164736:12345-0@lo:400: Request processed in 30us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920345.706287:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790920345.706299:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790920345.706304:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972164352:12345-0@lo:400: 00000100:00100000:0.0:1790920345.706327:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972164352:12345-0@lo:400: Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920345.706332:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790920345.706342:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790920345.706346:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972164480:12345-0@lo:400: 00000100:00100000:0.0:1790920345.706370:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972164480:12345-0@lo:400: Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920345.706375:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790920345.706407:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790920345.706412:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790920345.706531:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05628000 x1877915972164480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920345.706549:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972164480:0@lo:400: 00010000:00080000:1.0:1790920345.706562:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629c00 x1877915972164352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920345.706570:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972164352:0@lo:400: 00010000:00080000:1.0:1790920345.706588:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562a680 x1877915972164864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920345.706598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972164864:0@lo:400: 00010000:00080000:1.0:1790920345.706727:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562a300 x1877915972164736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920345.706737:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972164736:0@lo:400: 00010000:00080000:1.0:1790920345.706770:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562ad80 x1877915972164608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920345.706779:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972164608:0@lo:400: 00000100:00100000:0.0:1790920345.711971:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972164992:0@lo:13: 00000100:00100000:0.0:1790920345.712080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920345.712154:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164992 00000100:00100000:0.0:1790920345.712163:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164992 00000100:00100000:0.0:1790920345.712293:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790920345.712305:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972164992:12345-0@lo:13: 00002000:00000024:0.0:1790920345.712345:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920345.712404:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972164992:12345-0@lo:13: Request processed in 101us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920345.712411:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790920345.712476:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3443b480 x1877915972164992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920345.713358:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972164992:0@lo:13: 00000100:00100000:0.0:1790920345.730238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972164224 00000100:00100000:0.0:1790920345.730261:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972164224 00000100:00100000:0.0:1790920345.730968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790920345.730982:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972164224:12345-0@lo:400: 00000100:00100000:0.0:1790920345.731097:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972164224:12345-0@lo:400: Request processed in 118us (25462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920345.731105:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790920345.735030:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972164224:0@lo:400: 00000001:00080000:0.0:1790920345.804661:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1790920346.664963:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920347.698306:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920347.934118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920347.936098:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951169664 00000100:00100000:2.0:1790920347.936121:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951169664 00000100:00100000:2.0:1790920347.936332:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:2.0:1790920347.936342:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1877915951169664:12345-192.168.204.34@tcp:250: 00010000:00080000:2.0:1790920347.936378:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8@192.168.204.34@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1790920347.936432:0:5840:0:(genops.c:1384:class_connect()) connect: client 0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8, cookie 0x2a4915844546a07c 00000100:00080000:2.0:1790920347.936611:0:5840:0:(import.c:65:import_set_state_nolock()) ffff88eb41fdc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790920347.937570:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+5:2351:x1877915951169664:12345-192.168.204.34@tcp:250: Request processed in 1223us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920347.937606:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:3.0:1790920347.943646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920347.943734:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951169792 00000100:00100000:0.0:1790920347.943796:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951169792 00000100:00100000:0.0:1790920347.943857:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:0.0:1790920347.943870:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+5:5580:x1877915951169792:12345-192.168.204.34@tcp:101: 00010000:00010000:0.0:1790920347.943897:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920347.943923:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda966 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920347.943960:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920347.943974:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920347.944011:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00030600, rc 0) 00000100:00100000:0.0:1790920347.944098:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+6:5580:x1877915951169792:12345-192.168.204.34@tcp:101: Request processed in 229us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920347.944106:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:1.0:1790920347.961013:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920347.961371:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951169920 00000100:00100000:2.0:1790920347.961383:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951169920 00000100:00100000:2.0:1790920347.961462:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:2.0:1790920347.961474:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+6:5580:x1877915951169920:12345-192.168.204.34@tcp:501: 00000100:00100000:2.0:1790920347.961930:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+6:5580:x1877915951169920:12345-192.168.204.34@tcp:501: Request processed in 457us (930us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790920347.961940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:3.0:1790920347.984539:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920347.984604:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170048 00000100:00100000:3.0:1790920347.984617:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170048 00000100:00100000:3.0:1790920347.984680:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1790920347.984692:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+6:5580:x1877915951170048:12345-192.168.204.34@tcp:101: 00010000:00010000:3.0:1790920347.984713:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920347.984737:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda96d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920347.984821:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920347.984837:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920347.984847:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421ce200, rc 0) 00000100:00100000:3.0:1790920347.984993:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+7:5580:x1877915951170048:12345-192.168.204.34@tcp:101: Request processed in 300us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920347.985017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1790920347.996835:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920347.998042:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170176 00000100:00100000:1.0:1790920347.998059:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170176 00000100:00100000:1.0:1790920347.998322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:1.0:1790920347.998335:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+7:5580:x1877915951170176:12345-192.168.204.34@tcp:501: 00000100:00100000:1.0:1790920347.998801:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5580:x1877915951170176:12345-192.168.204.34@tcp:501: Request processed in 466us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920347.998810:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:3.0:1790920348.009335:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920348.009381:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170304 00000100:00100000:3.0:1790920348.009395:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170304 00000100:00100000:3.0:1790920348.009458:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:3.0:1790920348.009468:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5580:x1877915951170304:12345-192.168.204.34@tcp:503: 00000100:00100000:3.0:1790920348.013470:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5580:x1877915951170304:12345-192.168.204.34@tcp:503: Request processed in 3985us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920348.013487:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:2.0:1790920348.022969:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920348.023204:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170432 00000100:00100000:1.0:1790920348.023216:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170432 00000100:00100000:1.0:1790920348.023295:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:1.0:1790920348.023306:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5600:x1877915951170432:12345-192.168.204.34@tcp:502: 00000100:00100000:1.0:1790920348.025085:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5600:x1877915951170432:12345-192.168.204.34@tcp:502: Request processed in 1766us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920348.025103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:1.0:1790920348.065496:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920348.065541:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170560 00000100:00100000:1.0:1790920348.065553:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170560 00000100:00100000:1.0:1790920348.065625:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:1.0:1790920348.065636:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5600:x1877915951170560:12345-192.168.204.34@tcp:502: 00000100:00100000:1.0:1790920348.066507:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5600:x1877915951170560:12345-192.168.204.34@tcp:502: Request processed in 868us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920348.066519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:1.0:1790920348.083723:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920348.087339:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170688 00000100:00100000:0.0:1790920348.087363:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170688 00000100:00100000:3.0:1790920348.091866:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:3.0:1790920348.091883:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5580:x1877915951170688:12345-192.168.204.34@tcp:101: 00010000:00010000:3.0:1790920348.092362:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920348.092387:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421cf600/0x2a4915844546a091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda997 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920348.092437:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421cf600/0x2a4915844546a091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda997 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920348.092452:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421cf600/0x2a4915844546a091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda997 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920348.092462:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421cf600, rc 0) 00000100:00100000:3.0:1790920348.092547:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5580:x1877915951170688:12345-192.168.204.34@tcp:101: Request processed in 666us (9468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920348.092554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:1.0:1790920348.097443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920348.097774:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170816 00000100:00100000:2.0:1790920348.097786:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170816 00000100:00100000:2.0:1790920348.097857:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:2.0:1790920348.097868:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5580:x1877915951170816:12345-192.168.204.34@tcp:256: 20000000:01000000:2.0:1790920348.097911:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790920348.097941:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790920348.097945:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790920348.097949:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790920348.097952:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790920348.105934:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5580:x1877915951170816:12345-192.168.204.34@tcp:256: Request processed in 8053us (8489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920348.105953:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:0.0:1790920348.119266:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920348.119443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951170944 00000100:00100000:2.0:1790920348.119458:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951170944 00000100:00100000:2.0:1790920348.119534:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:2.0:1790920348.119546:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5580:x1877915951170944:12345-192.168.204.34@tcp:101: 00010000:00010000:2.0:1790920348.119567:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920348.119598:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda99e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920348.119635:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920348.119667:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920348.119678:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56aa00, rc 0) 00000100:00100000:2.0:1790920348.120629:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5580:x1877915951170944:12345-192.168.204.34@tcp:101: Request processed in 1079us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920348.120641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:2.0:1790920348.131743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920348.132140:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171072 00000100:00100000:0.0:1790920348.132152:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171072 00000100:00100000:0.0:1790920348.132523:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 124 00000100:00100000:0.0:1790920348.132536:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5580:x1877915951171072:12345-192.168.204.34@tcp:501: 00000100:00100000:0.0:1790920348.133314:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5580:x1877915951171072:12345-192.168.204.34@tcp:501: Request processed in 775us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920348.133326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 124 00000100:00100000:1.0:1790920348.142026:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920348.142640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171200 00000100:00100000:3.0:1790920348.142654:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171200 00000100:00100000:3.0:1790920348.142717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 125 00000100:00100000:3.0:1790920348.142730:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5580:x1877915951171200:12345-192.168.204.34@tcp:503: 00000100:00100000:3.0:1790920348.143546:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5580:x1877915951171200:12345-192.168.204.34@tcp:503: Request processed in 814us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920348.143558:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 125 00000100:00100000:0.0:1790920348.162649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920348.163106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171328 00000100:00100000:1.0:1790920348.163129:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171328 00000100:00100000:1.0:1790920348.164343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:1.0:1790920348.164369:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5604:x1877915951171328:12345-192.168.204.34@tcp:502: 00000100:00100000:1.0:1790920348.166646:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5604:x1877915951171328:12345-192.168.204.34@tcp:502: Request processed in 2215us (3936us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920348.166683:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:2.0:1790920348.188091:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920348.189720:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171456 00000100:00100000:3.0:1790920348.189737:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171456 00000100:00100000:3.0:1790920348.189833:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 127 00000100:00100000:3.0:1790920348.189846:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5604:x1877915951171456:12345-192.168.204.34@tcp:502: 00000100:00100000:3.0:1790920348.195387:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5604:x1877915951171456:12345-192.168.204.34@tcp:502: Request processed in 5526us (7294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920348.195415:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 127 00000100:00100000:1.0:1790920348.203514:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920348.204390:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171584 00000100:00100000:0.0:1790920348.204415:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171584 00000100:00100000:0.0:1790920348.204475:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1790920348.204485:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1877915951171584:12345-192.168.204.34@tcp:38: 00010000:00080000:0.0:1790920348.204520:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1790920348.204574:0:5845:0:(genops.c:1384:class_connect()) connect: client 23f7dc83-f18d-4470-88f4-3dd4c845ced7, cookie 0x2a4915844546a09f 00000004:00100000:0.0:1790920348.204893:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790920348.204901:0:5845:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1790920348.331337:0:5845:0:(import.c:65:import_set_state_nolock()) ffff88eb3f97f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920348.331477:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2351:x1877915951171584:12345-192.168.204.34@tcp:38: Request processed in 126988us (127974us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920348.331508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00010000:00010000:2.0:1790920348.714786:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920349.291919:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920349.291957:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972165120:0@lo:13: 00000100:00100000:0.0:1790920349.292251:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920349.292413:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972165120 00000100:00100000:3.0:1790920349.292422:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972165120 00000100:00100000:3.0:1790920349.292506:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790920349.292518:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972165120:12345-0@lo:13: 00002000:00000024:3.0:1790920349.292560:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920349.292616:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972165120:12345-0@lo:13: Request processed in 101us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920349.292623:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790920349.292670:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3443b480 x1877915972165120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920349.292709:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972165120:0@lo:13: 00000100:00080000:0.0:1790920349.293198:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920349.339011:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920349.339084:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920349.339239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171712 00000100:00100000:1.0:1790920349.339252:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171712 00000100:00100000:1.0:1790920349.339726:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171840 00000100:00100000:1.0:1790920349.339732:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171840 00000100:00080000:0.0:1790920349.344491:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920349.345869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1790920349.346698:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:0:x1877915951171712:12345-192.168.204.34@tcp:41: 00000004:00000024:3.0:1790920349.346815:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790920349.346953:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:0:x1877915951171712:12345-192.168.204.34@tcp:41: Request processed in 1068us (7959us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920349.346963:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1790920349.347188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:3.0:1790920349.347199:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5580:x1877915951171840:12345-192.168.204.34@tcp:41: 00000004:00000024:3.0:1790920349.347213:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790920349.347235:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5580:x1877915951171840:12345-192.168.204.34@tcp:41: Request processed in 41us (8151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920349.347242:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:3.0:1790920349.352435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920349.352638:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951171968 00000100:00100000:1.0:1790920349.352652:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951171968 00000100:00100000:1.0:1790920349.352727:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1790920349.352739:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5580:x1877915951171968:12345-192.168.204.34@tcp:40: 00000100:00100000:1.0:1790920349.352949:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5580:x1877915951171968:12345-192.168.204.34@tcp:40: Request processed in 211us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920349.352958:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1790920349.378144:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920349.378223:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920349.378264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920349.378318:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920349.378392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172480 00000100:00100000:0.0:1790920349.378404:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172480 00000100:00100000:0.0:1790920349.378467:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:0.0:1790920349.378478:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951172480:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1790920349.378571:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951172480:12345-192.168.204.34@tcp:400: Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920349.378580:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:3.0:1790920349.379368:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172096 00000100:00100000:3.0:1790920349.379391:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172096 00000100:00100000:3.0:1790920349.379431:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172224 00000100:00100000:3.0:1790920349.379434:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172224 00000100:00100000:3.0:1790920349.379448:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1790920349.379455:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1877915951172096:12345-192.168.204.34@tcp:8: 00010000:00080000:3.0:1790920349.379488:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1790920349.379527:0:6690:0:(genops.c:1384:class_connect()) connect: client 23f7dc83-f18d-4470-88f4-3dd4c845ced7, cookie 0x2a4915844546a0a6 00002000:00100000:3.0:1790920349.379542:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 23f7dc83-f18d-4470-88f4-3dd4c845ced7/ffff88eb3a4fe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790920349.379573:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790920349.380035:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790920349.380075:0:6690:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4ff800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790920349.380159:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2351:x1877915951172096:12345-192.168.204.34@tcp:8: Request processed in 703us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920349.380179:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1790920349.380398:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1790920349.380403:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1877915951172224:12345-192.168.204.34@tcp:8: 00010000:00080000:3.0:1790920349.380423:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1790920349.380444:0:6690:0:(genops.c:1384:class_connect()) connect: client 23f7dc83-f18d-4470-88f4-3dd4c845ced7, cookie 0x2a4915844546a0ad 00002000:00100000:3.0:1790920349.380451:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 23f7dc83-f18d-4470-88f4-3dd4c845ced7/ffff88eb3a4fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790920349.380472:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790920349.380726:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790920349.380776:0:6690:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790920349.380810:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2351:x1877915951172224:12345-192.168.204.34@tcp:8: Request processed in 405us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920349.380817:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:1.0:1790920349.381021:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172352 00000100:00100000:1.0:1790920349.381030:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172352 00000100:00100000:1.0:1790920349.381088:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1790920349.381107:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5580:x1877915951172352:12345-192.168.204.34@tcp:33: 00000004:00080000:1.0:1790920349.432623:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 51432us 00000004:00200000:2.0:1790920349.473406:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790920349.473554:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5580:x1877915951172352:12345-192.168.204.34@tcp:33: Request processed in 92451us (95419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920349.473585:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1790920349.705102:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920349.705235:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172608 00000100:00100000:2.0:1790920349.705248:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172608 00000100:00100000:2.0:1790920349.705356:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1790920349.705369:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5621:x1877915951172608:12345-192.168.204.34@tcp:101: 00010000:00010000:2.0:1790920349.705412:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920349.705447:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a0b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda9c8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920349.705538:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a0bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920349.705556:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a0bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920349.705784:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a0bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920349.705828:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790920349.705832:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920349.705849:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a0bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920349.705879:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a0b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9c8 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920349.705901:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a0bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9c8 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920349.705911:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2cc00) 00010000:00010000:2.0:1790920349.705914:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920349.705920:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ac00, rc 0) 00000100:00100000:2.0:1790920349.706047:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:5621:x1877915951172608:12345-192.168.204.34@tcp:101: Request processed in 680us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920349.706055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00010000:00010000:0.0:1790920349.737229:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920350.761258:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920350.825814:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972165248:0@lo:13: 00000100:00100000:3.0:1790920350.825927:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920350.826030:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972165248 00000100:00100000:1.0:1790920350.826041:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972165248 00000100:00100000:1.0:1790920350.826118:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790920350.826128:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972165248:12345-0@lo:13: 00002000:00000024:1.0:1790920350.826157:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790920350.832363:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790920350.835240:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972165504:0@lo:400: 00000100:00100000:0.0:1790920350.835361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920350.835441:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790920350.835449:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972165376:0@lo:400: 00000100:00100000:0.0:1790920350.835510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920350.835587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972165504 00000100:00100000:0.0:1790920350.835596:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972165504 00000100:00100000:0.0:1790920350.835663:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790920350.835674:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972165504:12345-0@lo:400: 00000100:00100000:0.0:1790920350.835737:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972165504:12345-0@lo:400: Request processed in 64us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920350.835794:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790920350.835867:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972165504:0@lo:400: 00000100:00100000:0.0:1790920350.835918:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972165632:0@lo:400: 00000100:00100000:0.0:1790920350.835946:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920350.835984:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972165632 00000100:00100000:0.0:1790920350.835988:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972165632 00000100:00100000:0.0:1790920350.836021:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790920350.836028:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972165632:12345-0@lo:400: 00000100:00100000:0.0:1790920350.836064:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972165632:12345-0@lo:400: Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920350.836069:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790920350.836085:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920350.836104:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972165632:0@lo:400: 00000100:00100000:0.0:1790920350.836135:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972165376 00000100:00100000:0.0:1790920350.836139:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972165376 00000100:00100000:0.0:1790920350.836164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790920350.836170:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972165376:12345-0@lo:400: 00000100:00100000:0.0:1790920350.836207:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972165376:12345-0@lo:400: Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920350.836224:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790920350.836260:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972165376:0@lo:400: 00000100:00100000:2.0:1790920350.842982:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972165888:0@lo:400: 00000100:00100000:2.0:1790920350.843082:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920350.843546:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972165888 00000100:00100000:2.0:1790920350.843558:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972165888 00000100:00100000:2.0:1790920350.843642:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790920350.843653:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972165888:12345-0@lo:400: 00000100:00100000:2.0:1790920350.843744:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972165888:12345-0@lo:400: Request processed in 93us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920350.843787:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1790920350.843814:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920350.843858:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972165888:0@lo:400: 00000100:00100000:0.0:1790920350.846079:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920350.846120:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972165760:0@lo:400: 00000100:00100000:0.0:1790920350.846447:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920350.846742:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972165760 00000100:00100000:2.0:1790920350.846788:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972165760 00000100:00100000:2.0:1790920350.846860:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920350.846871:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972165760:12345-0@lo:400: 00000100:00100000:2.0:1790920350.846957:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972165760:12345-0@lo:400: Request processed in 89us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920350.847308:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790920350.847385:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a28a80 x1877915972165760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920350.847402:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972165760:0@lo:400: 00000100:00100000:1.0:1790920350.849063:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972165248:12345-0@lo:13: Request processed in 22922us (23120us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920350.849080:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790920350.850513:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3443bb80 x1877915972165248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920350.850533:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790920350.850579:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972165248:0@lo:13: 00010000:00010000:0.0:1790920351.785247:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920352.109541:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920352.110413:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172736 00000100:00100000:2.0:1790920352.110429:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172736 00000100:00100000:2.0:1790920352.110542:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:2.0:1790920352.110555:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:5673:x1877915951172736:12345-192.168.204.34@tcp:41: 00000004:00000024:2.0:1790920352.110615:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790920352.110905:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:5673:x1877915951172736:12345-192.168.204.34@tcp:41: Request processed in 160us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920352.110916:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00080000:0.0:1790920352.111394:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920352.116635:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920352.116834:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172864 00000100:00100000:3.0:1790920352.116864:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172864 00000100:00100000:3.0:1790920352.116973:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1790920352.116984:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5673:x1877915951172864:12345-192.168.204.34@tcp:13: 00002000:00000024:3.0:1790920352.117038:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920352.117256:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5673:x1877915951172864:12345-192.168.204.34@tcp:13: Request processed in 272us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920352.117264:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00080000:0.0:1790920352.119155:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920352.122797:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920352.123170:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951172992 00000100:00100000:0.0:1790920352.123185:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951172992 00000100:00100000:0.0:1790920352.123282:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1790920352.123294:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5673:x1877915951172992:12345-192.168.204.34@tcp:13: 00002000:00000024:0.0:1790920352.123354:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920352.123443:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:5673:x1877915951172992:12345-192.168.204.34@tcp:13: Request processed in 151us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920352.123451:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00080000:2.0:1790920352.123840:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790920352.809111:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790920353.493715:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00010000:00010000:3.0:1790920353.842939:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920353.897015:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972166144:0@lo:400: 00000100:00100000:2.0:1790920353.897136:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920353.897196:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972166656:0@lo:400: 00000100:00100000:2.0:1790920353.897222:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920353.897258:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790920353.897264:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972166272:0@lo:400: 00000100:00100000:2.0:1790920353.897286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920353.897334:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166144 00000100:00100000:2.0:1790920353.897343:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166144 00000100:00100000:2.0:1790920353.897408:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166272 00000100:00100000:2.0:1790920353.897411:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166272 00000100:00100000:2.0:1790920353.897438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790920353.897447:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972166144:12345-0@lo:400: 00000100:00100000:2.0:1790920353.897499:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972166144:12345-0@lo:400: Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920353.897507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790920353.897525:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790920353.897531:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972166272:12345-0@lo:400: 00000100:00100000:2.0:1790920353.897556:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972166272:12345-0@lo:400: Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920353.897562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790920353.897580:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166656 00000100:00100000:2.0:1790920353.897584:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166656 00000100:00100000:2.0:1790920353.897612:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790920353.897619:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972166656:12345-0@lo:400: 00000100:00100000:2.0:1790920353.897646:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972166656:12345-0@lo:400: Request processed in 29us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920353.897653:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1790920353.897683:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920353.897688:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920353.897722:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972166272:0@lo:400: 00000100:00100000:2.0:1790920353.897733:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972166144:0@lo:400: 00010000:00080000:2.0:1790920353.897771:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41827b80 x1877915972166656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920353.897785:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972166656:0@lo:400: 00000100:00100000:0.0:1790920353.898656:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972166016:0@lo:400: 00000100:00100000:0.0:1790920353.898710:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920353.898761:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972166528:0@lo:400: 00000100:00100000:0.0:1790920353.898805:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920353.898827:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790920353.898834:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972166400:0@lo:400: 00000100:00100000:0.0:1790920353.898872:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920353.898920:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166016 00000100:00100000:0.0:1790920353.898925:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166016 00000100:00100000:0.0:1790920353.898966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790920353.898974:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972166016:12345-0@lo:400: 00000100:00100000:0.0:1790920353.899017:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972166016:12345-0@lo:400: Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920353.899024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790920353.899614:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166400 00000100:00100000:0.0:1790920353.899623:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166400 00000100:00100000:0.0:1790920353.899677:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790920353.899688:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972166400:12345-0@lo:400: 00000100:00100000:0.0:1790920353.899972:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972166400:12345-0@lo:400: Request processed in 286us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920353.899981:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790920353.900028:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41824700 x1877915972166400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920353.900219:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972166400:0@lo:400: 00000100:00100000:0.0:1790920353.900237:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972166016:0@lo:400: 00000100:00080000:2.0:1790920353.901550:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920353.901577:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166528 00000100:00100000:2.0:1790920353.901584:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166528 00000100:00100000:2.0:1790920353.901637:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790920353.901646:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972166528:12345-0@lo:400: 00000100:00100000:2.0:1790920353.901725:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972166528:12345-0@lo:400: Request processed in 79us (2919us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920353.901732:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790920353.901996:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920353.902048:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972166528:0@lo:400: 00000001:00100000:0.0:1790920354.173174:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000100:00100000:1.0:1790920354.412245:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920354.412293:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972166784:0@lo:13: 00000100:00100000:1.0:1790920354.412388:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920354.413459:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166784 00000100:00100000:0.0:1790920354.413472:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166784 00000100:00100000:0.0:1790920354.413549:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790920354.413560:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972166784:12345-0@lo:13: 00002000:00000024:0.0:1790920354.413606:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920354.413689:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972166784:12345-0@lo:13: Request processed in 131us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920354.413709:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790920354.413836:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33ff9c00 x1877915972166784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920354.413860:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972166784:0@lo:13: 00000100:00100000:0.0:1790920354.445504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920354.445550:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920354.445590:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920354.445619:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920354.445649:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951173120 00000100:00100000:0.0:1790920354.445659:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951173120 00000100:00100000:0.0:1790920354.445732:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:0.0:1790920354.445774:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2355:x1877915951173120:12345-192.168.204.34@tcp:400: 00000100:00100000:2.0:1790920354.446225:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951173504 00000100:00100000:2.0:1790920354.446231:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951173504 00000100:00100000:2.0:1790920354.446292:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951173376 00000100:00100000:2.0:1790920354.446296:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951173376 00000100:00100000:2.0:1790920354.446320:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1790920354.446328:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951173504:12345-192.168.204.34@tcp:400: 00000100:00080000:2.0:1790920354.446390:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920354.446395:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790920354.446406:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790920354.446417:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790920354.446644:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951173248 00000100:00100000:3.0:1790920354.446650:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951173248 00000100:00100000:3.0:1790920354.446694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:3.0:1790920354.446702:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951173248:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1790920354.447577:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2355:x1877915951173120:12345-192.168.204.34@tcp:400: Request processed in 1828us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920354.447589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:1.0:1790920354.448388:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790920354.448410:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:1.0:1790920354.448425:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951173376:12345-192.168.204.34@tcp:400: 00000100:00100000:2.0:1790920354.448610:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951173504:12345-192.168.204.34@tcp:400: Request processed in 2281us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920354.448619:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00080000:2.0:1790920354.448692:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920354.457922:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951173248:12345-192.168.204.34@tcp:400: Request processed in 11202us (12413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920354.457943:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:1.0:1790920354.459785:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951173376:12345-192.168.204.34@tcp:400: Request processed in 11327us (14126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920354.460105:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000001:00100000:3.0:1790920354.531783:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00010000:00010000:2.0:1790920354.859590:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920355.882036:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920355.952767:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790920355.952807:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972166912:0@lo:13: 00000100:00100000:1.0:1790920355.952898:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920355.953009:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972166912 00000100:00100000:1.0:1790920355.953021:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972166912 00000100:00100000:1.0:1790920355.953107:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790920355.953122:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972166912:12345-0@lo:13: 00002000:00000024:1.0:1790920355.953176:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920355.953266:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972166912:12345-0@lo:13: Request processed in 136us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920355.953275:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790920355.953334:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33ff8a80 x1877915972166912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920355.953357:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972166912:0@lo:13: 00000100:00080000:2.0:1790920355.953520:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1790920356.539437:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790920356.909028:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920357.929043:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920358.957994:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920359.019864:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972167040:0@lo:400: 00000100:00100000:3.0:1790920359.019865:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972167168:0@lo:400: 00000100:00100000:1.0:1790920359.020019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920359.020071:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972167424:0@lo:400: 00000100:00100000:1.0:1790920359.020096:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972167552:0@lo:400: 00000100:00100000:2.0:1790920359.020120:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920359.020133:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920359.020164:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972167040 00000100:00100000:2.0:1790920359.020175:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972167424 00000100:00100000:0.0:1790920359.020175:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972167040 00000100:00100000:2.0:1790920359.020181:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972167424 00000100:00100000:0.0:1790920359.020253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790920359.020266:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790920359.020267:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972167040:12345-0@lo:400: 00000100:00100000:2.0:1790920359.020280:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972167424:12345-0@lo:400: 00000100:00100000:0.0:1790920359.020349:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972167040:12345-0@lo:400: Request processed in 86us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920359.020352:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972167424:12345-0@lo:400: Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920359.020364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790920359.020377:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790920359.020407:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972167552 00000100:00100000:2.0:1790920359.020411:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972167552 00000100:00100000:0.0:1790920359.020436:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972167040:0@lo:400: 00000100:00100000:2.0:1790920359.020448:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790920359.020458:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972167552:12345-0@lo:400: 00000100:00100000:2.0:1790920359.020507:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972167552:12345-0@lo:400: Request processed in 51us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920359.020514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790920359.020533:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790920359.020539:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790920359.020563:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05843b80 x1877915972167424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920359.020575:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972167424:0@lo:400: 00000100:00100000:0.0:1790920359.020923:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972167552:0@lo:400: 00000100:00100000:1.0:1790920359.022144:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972167296:0@lo:400: 00000100:00100000:1.0:1790920359.022218:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920359.022269:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972167296 00000100:00100000:1.0:1790920359.022275:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972167296 00000100:00100000:1.0:1790920359.022317:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790920359.022325:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972167296:12345-0@lo:400: 00000100:00100000:1.0:1790920359.022372:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972167296:12345-0@lo:400: Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920359.022380:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790920359.022414:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972167296:0@lo:400: 00000100:00080000:2.0:1790920359.022501:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920359.025830:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920359.025903:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972167680:0@lo:400: 00000100:00100000:2.0:1790920359.025933:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972167168 00000100:00100000:2.0:1790920359.025950:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972167168 00000100:00100000:3.0:1790920359.025962:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920359.026032:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790920359.026047:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972167168:12345-0@lo:400: 00000100:00100000:2.0:1790920359.026155:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972167168:12345-0@lo:400: Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920359.026164:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790920359.026251:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972167168:0@lo:400: 00000100:00100000:0.0:1790920359.027112:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972167680 00000100:00100000:0.0:1790920359.027121:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972167680 00000100:00100000:0.0:1790920359.027217:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790920359.027227:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972167680:12345-0@lo:400: 00000100:00100000:0.0:1790920359.027291:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972167680:12345-0@lo:400: Request processed in 67us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920359.027298:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790920359.027943:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790920359.029698:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34251f80 x1877915972167680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920359.029718:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972167680:0@lo:400: 00000100:00100000:2.0:1790920359.531999:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790920359.532031:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972167808:0@lo:13: 00000100:00100000:2.0:1790920359.532110:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920359.532529:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972167808 00000100:00100000:1.0:1790920359.532546:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972167808 00000100:00100000:1.0:1790920359.532616:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790920359.532629:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972167808:12345-0@lo:13: 00002000:00000024:1.0:1790920359.532678:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920359.533468:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972167808:12345-0@lo:13: Request processed in 839us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920359.533478:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1790920359.533598:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41827b80 x1877915972167808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920359.533637:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972167808:0@lo:13: 00000100:00100000:0.0:1790920359.574100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920359.574232:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920359.574264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920359.574297:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951173888 00000100:00100000:0.0:1790920359.574297:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920359.574314:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951173888 00000100:00100000:0.0:1790920359.574334:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951173760 00000100:00100000:0.0:1790920359.574344:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951173760 00000100:00100000:0.0:1790920359.574439:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:3.0:1790920359.574443:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174016 00000100:00100000:3.0:1790920359.574450:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174016 00000100:00100000:0.0:1790920359.574456:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951173760:12345-192.168.204.34@tcp:400: 00000100:00100000:3.0:1790920359.574490:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:3.0:1790920359.574502:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951173888:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1790920359.574560:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951173760:12345-192.168.204.34@tcp:400: Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920359.574583:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:3.0:1790920359.574611:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951173888:12345-192.168.204.34@tcp:400: Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920359.574625:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920359.574650:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1790920359.574666:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951174016:12345-192.168.204.34@tcp:400: 00000100:00080000:3.0:1790920359.574675:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790920359.574685:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790920359.574691:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920359.574726:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951174016:12345-192.168.204.34@tcp:400: Request processed in 52us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920359.574734:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1790920359.574985:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951173632 00000100:00100000:1.0:1790920359.574992:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951173632 00000100:00100000:1.0:1790920359.575088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:1.0:1790920359.575113:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951173632:12345-192.168.204.34@tcp:400: 00000100:00100000:1.0:1790920359.575149:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951173632:12345-192.168.204.34@tcp:400: Request processed in 40us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920359.575158:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 133 00010000:00010000:3.0:1790920359.978236:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790920360.865296:0:8455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc906861e0 20000000:00000080:2.0:1790920360.865329:0:8455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88eb3ab27800 uarg=0000000000000000 20000000:01000000:2.0:1790920360.865378:0:8455:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1790920360.865381:0:8455:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1790920360.865385:0:8455:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790920360.865391:0:8455:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790920360.865397:0:8455:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1790920360.865415:0:8455:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790920360.865418:0:8455:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790920360.865683:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790920360.865686:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790920360.870310:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1790920360.873558:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1790920360.873667:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1790920360.873704:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1790920360.873723:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790920360.873727:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790920360.878427:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1790920360.881542:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1790920360.881610:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1790920360.881673:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1790920360.881687:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790920360.881690:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790920360.885384:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1790920360.886092:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1790920360.886148:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1790920360.886197:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1790920360.886214:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790920360.886226:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790920360.888171:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790920360.889907:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790920360.890027:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1790920360.890071:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1790920360.890095:0:8455:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790920360.890120:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890141:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469fb8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890149:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469fe2 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890168:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a00c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890176:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a01a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890182:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a028 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890190:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a044 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890196:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a06e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890206:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890234:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890242:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890295:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890313:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 9 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890329:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972167936:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920360.890474:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890483:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 9 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890491:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168064:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920360.890524:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a06e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890532:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a06e expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890542:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168192:0@lo:104: 00000100:00100000:0.0:1790920360.890607:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790920360.890667:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a044 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890675:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a044 expref: 18 pid: 5840 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890684:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168320:0@lo:104: 00000100:00100000:0.0:1790920360.890707:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790920360.890743:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a028 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890782:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a028 expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890790:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168448:0@lo:104: 00010000:00010000:0.0:1790920360.890817:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a01a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890825:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a01a expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890834:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168576:0@lo:104: 00010000:00010000:0.0:1790920360.890858:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a00c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890866:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a00c expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890873:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168704:0@lo:104: 00010000:00010000:0.0:1790920360.890903:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469fe2 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890917:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469fe2 expref: 18 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.890925:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168832:0@lo:104: 00000100:00100000:3.0:1790920360.890929:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790920360.890948:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790920360.890972:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469fb8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.890981:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469fb8 expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.890985:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920360.890989:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168960:0@lo:104: 00000100:00100000:3.0:1790920360.890998:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920360.891007:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920360.891026:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920360.891038:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2000 going to sleep for 11 seconds 00000100:00100000:3.0:1790920360.891043:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972168192 00000100:00100000:3.0:1790920360.891051:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972168192 00000100:00100000:3.0:1790920360.891101:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972168320 00000100:00100000:3.0:1790920360.891103:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972168320 00000100:00100000:3.0:1790920360.891112:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972168832 00000100:00100000:3.0:1790920360.891114:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972168832 00000100:00100000:3.0:1790920360.891121:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972168448 00000100:00100000:3.0:1790920360.891130:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972168448 00000100:00100000:3.0:1790920360.891143:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972168576 00000100:00100000:3.0:1790920360.891145:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972168576 00000100:00100000:3.0:1790920360.891166:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972168704 00000100:00100000:3.0:1790920360.891169:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972168704 00000100:00100000:2.0:1790920360.891236:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790920360.891251:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+8:8455:x1877915972168192:12345-0@lo:104: 00010000:00010000:2.0:1790920360.891268:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891335:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790920360.891342:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+8:8455:x1877915972168192:12345-0@lo:104: Request processed in 95us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.891348:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790920360.891369:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790920360.891375:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3aa59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+7:8455:x1877915972168320:12345-0@lo:104: 00010000:00010000:2.0:1790920360.891382:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891408:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972168960 00000100:00100000:3.0:1790920360.891412:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972168960 00010000:00010000:2.0:1790920360.891415:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790920360.891419:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3aa59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+8:8455:x1877915972168320:12345-0@lo:104: Request processed in 46us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.891424:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790920360.891430:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790920360.891435:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+7:8455:x1877915972168832:12345-0@lo:104: 00010000:00010000:3.0:1790920360.891442:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891465:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790920360.891472:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891480:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029efa00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:2.0:1790920360.891484:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.891487:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790920360.891492:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+7:8455:x1877915972168832:12345-0@lo:104: Request processed in 57us (544us total) trans 0 rc 0/0 00010000:00010000:2.0:1790920360.891494:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891497:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790920360.891507:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 10000000:00010000:2.0:1790920360.891507:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891513:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+6:8455:x1877915972168448:12345-0@lo:104: 10000000:01000000:2.0:1790920360.891514:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790920360.891519:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.891543:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790920360.891546:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+6:8455:x1877915972168448:12345-0@lo:104: Request processed in 35us (578us total) trans 0 rc 0/0 00010000:00010000:2.0:1790920360.891549:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891552:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1790920360.891555:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790920360.891563:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790920360.891568:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:8455:x1877915972168576:12345-0@lo:104: 00010000:00010000:3.0:1790920360.891575:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891577:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891585:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb029efa00/0x2a4915844546a06e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a075 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891601:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790920360.891604:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891610:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc1c7fc20) 00010000:00010000:3.0:1790920360.891611:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:2.0:1790920360.891613:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891616:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:8455:x1877915972168576:12345-0@lo:104: Request processed in 49us (617us total) trans 0 rc 0/0 00010000:00010000:2.0:1790920360.891620:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891622:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 10000000:00010000:2.0:1790920360.891627:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891633:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 10000000:01000000:2.0:1790920360.891633:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1790920360.891638:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:8455:x1877915972168704:12345-0@lo:104: 00010000:00010000:3.0:1790920360.891645:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891651:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891656:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790920360.891661:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891667:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a000/0x2a4915844546a044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a04b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.891668:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790920360.891672:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:8455:x1877915972168704:12345-0@lo:104: Request processed in 35us (665us total) trans 0 rc 0/0 00010000:00010000:2.0:1790920360.891676:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1790920360.891677:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1790920360.891679:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891685:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030a00 already unused, calling callback (ffffffffc1c7fc20) 00000100:00100000:3.0:1790920360.891687:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 10000000:00010000:2.0:1790920360.891688:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.891692:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:8455:x1877915972168960:12345-0@lo:104: 00010000:00010000:2.0:1790920360.891695:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.891700:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790920360.891701:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920360.891707:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790920360.891717:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.891722:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1790920360.891724:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790920360.891726:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:8455:x1877915972168960:12345-0@lo:104: Request processed in 34us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920360.891732:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790920360.891740:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891788:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00030a00/0x2a49158445469fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fe9 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891800:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790920360.891815:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891821:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421ce000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:2.0:1790920360.891824:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891832:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790920360.891839:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920360.891844:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790920360.891860:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891866:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790920360.891872:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891878:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a028 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a02f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891888:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790920360.891896:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891902:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cf400 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:2.0:1790920360.891905:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891913:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790920360.891918:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920360.891923:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790920360.891936:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891941:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790920360.891946:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891952:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421cf400/0x2a4915844546a01a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a021 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891962:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790920360.891964:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891970:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cf000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:2.0:1790920360.891973:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.891991:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790920360.891998:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920360.892004:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790920360.892017:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892023:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790920360.892027:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892034:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a00c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a013 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892044:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920360.892047:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892052:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030800 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:2.0:1790920360.892055:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892062:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790920360.892068:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920360.892079:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790920360.892091:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892097:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790920360.892101:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892106:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00030800/0x2a49158445469fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.892120:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920360.892121:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920360.892123:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920360.892130:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920360.892144:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169088:0@lo:103: 00000100:00100000:2.0:1790920360.892193:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920360.892230:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169600:0@lo:103: 00000100:00100000:2.0:1790920360.892251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920360.892272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169088 00000100:00100000:2.0:1790920360.892274:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790920360.892277:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169088 00000100:00100000:2.0:1790920360.892280:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169216:0@lo:103: 00010000:00010000:3.0:1790920360.892297:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a06e expref: 19 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920360.892298:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920360.892311:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169728:0@lo:103: 00000100:00100000:3.0:1790920360.892324:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169600 00000100:00100000:2.0:1790920360.892326:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920360.892327:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169600 00010000:00010000:3.0:1790920360.892338:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a01a expref: 20 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.892348:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169216 00000100:00100000:2.0:1790920360.892348:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972169344:0@lo:103: 00000100:00100000:3.0:1790920360.892350:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169216 00010000:00010000:3.0:1790920360.892359:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a044 expref: 21 pid: 5840 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.892368:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169728 00000100:00100000:3.0:1790920360.892370:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169728 00000100:00100000:2.0:1790920360.892370:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790920360.892379:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a00c expref: 22 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.892387:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169344 00000100:00100000:2.0:1790920360.892387:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972169856:0@lo:103: 00000100:00100000:3.0:1790920360.892389:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169344 00010000:00010000:3.0:1790920360.892397:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469fe2 expref: 23 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920360.892403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920360.892406:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169856 00000100:00100000:3.0:1790920360.892409:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169856 00000100:00100000:2.0:1790920360.892414:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1790920360.892418:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469fb8 expref: 24 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920360.892418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972169472:0@lo:103: 00000100:00100000:3.0:1790920360.892430:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790920360.892436:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+24:3304:x1877915972169088:12345-0@lo:103: 00010000:00010000:3.0:1790920360.892448:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920360.892454:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a06e expref: 24 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920360.892455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920360.892480:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1790920360.892485:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a06e expref: 24 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920360.892486:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790920360.892503:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1790920360.892504:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.892509:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169472 00000100:00100000:2.0:1790920360.892512:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169472 00010000:00010000:2.0:1790920360.892525:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a028 expref: 25 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.892536:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+25:3304:x1877915972169088:12345-0@lo:103: Request processed in 100us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.892539:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790920360.892542:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790920360.892546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790920360.892551:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+24:3304:x1877915972169600:12345-0@lo:103: 00000100:00100000:3.0:1790920360.892552:0:5832:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790920360.892557:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1790920360.892558:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790920360.892562:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+24:3304:x1877915972169216:12345-0@lo:103: 00010000:00010000:2.0:1790920360.892562:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a01a expref: 24 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.892569:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920360.892571:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a01a expref: 24 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.892572:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a044 expref: 24 pid: 5840 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.892582:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a044 expref: 24 pid: 5840 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894222:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.894308:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+24:3304:x1877915972169600:12345-0@lo:103: Request processed in 1752us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.894323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790920360.894358:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790920360.894370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790920360.894384:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+23:3304:x1877915972169728:12345-0@lo:103: 00010000:00010000:2.0:1790920360.894414:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920360.894424:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a00c expref: 23 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894439:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a00c expref: 23 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894457:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.894481:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+23:3304:x1877915972169728:12345-0@lo:103: Request processed in 102us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.894487:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790920360.894498:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790920360.894504:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790920360.894510:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+22:3306:x1877915972169344:12345-0@lo:103: 00010000:00010000:2.0:1790920360.894518:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920360.894522:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469fe2 expref: 22 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894530:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469fe2 expref: 22 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894539:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.894567:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+22:3306:x1877915972169344:12345-0@lo:103: Request processed in 57us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.894572:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790920360.894583:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790920360.894589:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790920360.894594:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+21:3306:x1877915972169856:12345-0@lo:103: 00010000:00010000:2.0:1790920360.894604:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920360.894614:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469fb8 expref: 21 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894622:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469fb8 expref: 21 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894630:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.894654:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+21:3306:x1877915972169856:12345-0@lo:103: Request processed in 60us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.894661:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790920360.894672:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790920360.894680:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790920360.894686:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+20:3306:x1877915972169472:12345-0@lo:103: 00010000:00010000:2.0:1790920360.894694:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920360.894699:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a028 expref: 20 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894708:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a028 expref: 20 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.894718:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.894740:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+20:3306:x1877915972169472:12345-0@lo:103: Request processed in 55us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.894774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1790920360.894989:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a06e expref: 19 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.895004:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168192:0@lo:104: 00000100:00100000:0.0:1790920360.895016:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168320:0@lo:104: 00010000:00010000:0.0:1790920360.895026:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029efe00/0x2a4915844546a02f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a028 expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.895036:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168448:0@lo:104: 00010000:00010000:0.0:1790920360.895044:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030000/0x2a4915844546a021 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a01a expref: 17 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.895054:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168576:0@lo:104: 00010000:00010000:0.0:1790920360.895074:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029eea00/0x2a4915844546a013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a00c expref: 16 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.895086:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168704:0@lo:104: 00010000:00010000:0.0:1790920360.895096:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029ef200/0x2a49158445469fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469fe2 expref: 15 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.895104:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168832:0@lo:104: 00010000:00010000:0.0:1790920360.895115:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421cfc00/0x2a49158445469fbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469fb8 expref: 14 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920360.895123:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168960:0@lo:104: 00000100:00100000:1.0:1790920360.895423:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972169472:0@lo:103: 00000100:00100000:1.0:1790920360.895432:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972169344:0@lo:103: 00000100:00100000:1.0:1790920360.895440:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972169856:0@lo:103: 00000100:00100000:2.0:1790920360.896112:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169728:0@lo:103: 00000100:00100000:2.0:1790920360.896124:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169088:0@lo:103: 00000100:00100000:2.0:1790920360.896134:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169600:0@lo:103: 00010000:00010000:3.0:1790920360.896559:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56a200/0x2a4915844546a04b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a044 expref: 13 pid: 5840 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920360.896579:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920360.896666:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:3304:x1877915972169216:12345-0@lo:103: Request processed in 4102us (4365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920360.896676:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920360.897374:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972169216:0@lo:103: 00000100:00100000:0.0:1790920360.899091:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972167936:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920360.899110:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1877915972168064:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920360.899255:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920360.906298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920360.906684:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174144 00000100:00100000:2.0:1790920360.906697:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174144 00010000:00010000:2.0:1790920360.906797:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 10 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920360.906856:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1790920360.906869:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2355:x1877915951174144:12345-192.168.204.34@tcp:103: 00010000:00010000:2.0:1790920360.906888:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920360.906896:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 10 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.906912:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 10 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.906934:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030600/0x2a4915844546a083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda966 expref: 10 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.906955:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.907032:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:2355:x1877915951174144:12345-192.168.204.34@tcp:103: Request processed in 164us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.907040:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:1.0:1790920360.910220:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920360.910860:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174272 00000100:00100000:2.0:1790920360.910874:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174272 00010000:00010000:2.0:1790920360.910927:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 9 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920360.910985:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:2.0:1790920360.910996:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:2354:x1877915951174272:12345-192.168.204.34@tcp:103: 00010000:00010000:2.0:1790920360.911035:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920360.911042:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 9 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911055:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 9 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911076:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421ce200/0x2a4915844546a08a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda96d expref: 9 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911097:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911106:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911126:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911133:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911140:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911147:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911153:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031a00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920360.911168:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911187:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911206:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920360.911217:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920360.911284:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:2354:x1877915951174272:12345-192.168.204.34@tcp:103: Request processed in 290us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920360.911291:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00010000:00010000:0.0:1790920360.911415:0:8455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.911424:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920360.911431:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920361.002084:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920361.065037:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920361.065074:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972169984:0@lo:13: 00000100:00100000:1.0:1790920361.065176:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920361.065265:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972169984 00000100:00100000:1.0:1790920361.065274:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972169984 00000100:00100000:1.0:1790920361.065339:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790920361.065349:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972169984:12345-0@lo:13: 00002000:00000024:1.0:1790920361.065391:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920361.065442:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972169984:12345-0@lo:13: Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920361.065449:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790920361.065473:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790920361.065509:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629180 x1877915972169984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920361.065529:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972169984:0@lo:13: 00010000:00010000:2.0:1790920362.025416:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790920362.600985:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790920362.600996:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb3a4ce000 from 39 10000000:01000000:1.0:1790920362.601027:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790920362.601085:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.601098:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.601112:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920362.601152:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170112:0@lo:101: 00000100:00100000:1.0:1790920362.601440:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.601526:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.602390:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972170112 00000100:00100000:0.0:1790920362.602403:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972170112 00000100:00100000:0.0:1790920362.602493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790920362.602503:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+12:5842:x1877915972170112:12345-0@lo:101: 00010000:00010000:0.0:1790920362.602520:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920362.602540:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a0c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.602572:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a0c9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.602585:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a0c9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.602597:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031a00, rc 0) 00000100:00100000:0.0:1790920362.602683:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972170112:12345-0@lo:101: Request processed in 181us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.602690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790920362.603340:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170112:0@lo:101: 00010000:00010000:1.0:1790920362.603368:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.603380:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920362.603469:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170240:0@lo:501: 00000100:00100000:1.0:1790920362.603519:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.603571:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.606025:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972170240 00000100:00100000:0.0:1790920362.606044:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972170240 00000100:00100000:0.0:1790920362.606190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790920362.606212:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972170240:12345-0@lo:501: 00000100:00100000:0.0:1790920362.606629:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972170240:12345-0@lo:501: Request processed in 427us (3109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.606638:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790920362.606811:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170240:0@lo:501: 00000100:00100000:1.0:1790920362.614293:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170368:0@lo:503: 00000100:00100000:1.0:1790920362.614427:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.619932:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920362.623483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972170368 00000100:00100000:2.0:1790920362.623505:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972170368 00000100:00100000:2.0:1790920362.623595:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790920362.623607:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972170368:12345-0@lo:503: 00000100:00100000:2.0:1790920362.625419:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972170368:12345-0@lo:503: Request processed in 1807us (10985us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920362.625434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790920362.626308:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170368:0@lo:503: 00000100:00100000:1.0:1790920362.627505:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8472:1877915972170496:0@lo:502: 00000100:00100000:1.0:1790920362.627596:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.629168:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721a540 going to sleep for 11 seconds 00000100:00100000:2.0:1790920362.629596:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972170496 00000100:00100000:2.0:1790920362.629643:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972170496 00000100:00100000:2.0:1790920362.629766:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790920362.629777:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:8472:x1877915972170496:12345-0@lo:502: 00000100:00100000:2.0:1790920362.630546:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:8472:x1877915972170496:12345-0@lo:502: Request processed in 768us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920362.630562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790920362.630993:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8472:1877915972170496:0@lo:502: 00000100:00100000:1.0:1790920362.631071:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8472:1877915972170624:0@lo:502: 00000100:00100000:1.0:1790920362.631120:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.631174:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0721a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.631305:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972170624 00000100:00100000:0.0:1790920362.631311:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972170624 00000100:00100000:0.0:1790920362.631363:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790920362.631373:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:8472:x1877915972170624:12345-0@lo:502: 00000100:00100000:0.0:1790920362.631594:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:8472:x1877915972170624:12345-0@lo:502: Request processed in 222us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.631609:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790920362.632083:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8472:1877915972170624:0@lo:502: 00000040:00080000:1.0:1790920362.632134:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790920362.633484:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790920362.633515:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790920362.633528:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.633543:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920362.633556:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1790920362.633559:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1790920362.633562:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790920362.633609:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.633618:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.633631:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920362.633990:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170752:0@lo:101: 00000100:00100000:0.0:1790920362.634064:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920362.634113:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920362.634331:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972170752 00000100:00100000:1.0:1790920362.634339:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972170752 00000100:00100000:1.0:1790920362.634395:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790920362.634404:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+13:5842:x1877915972170752:12345-0@lo:101: 00010000:00010000:1.0:1790920362.634420:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920362.634438:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029eee00/0x2a4915844546a0de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a0d7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.634467:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029eee00/0x2a4915844546a0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a0d7 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.634479:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029eee00/0x2a4915844546a0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a0d7 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.634489:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029eee00, rc 0) 00000100:00100000:1.0:1790920362.634550:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972170752:12345-0@lo:101: Request processed in 147us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920362.634557:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790920362.635105:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170752:0@lo:101: 00010000:00010000:3.0:1790920362.635135:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.635154:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920362.635360:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170880:0@lo:501: 00000100:00100000:3.0:1790920362.635398:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.635432:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d0e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920362.636500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972170880 00000100:00100000:2.0:1790920362.636511:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972170880 00000100:00100000:2.0:1790920362.636587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790920362.636597:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972170880:12345-0@lo:501: 00000100:00100000:2.0:1790920362.637108:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972170880:12345-0@lo:501: Request processed in 510us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920362.637117:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790920362.638510:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972170880:0@lo:501: 00000100:00100000:3.0:1790920362.638585:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171008:0@lo:503: 00000100:00100000:3.0:1790920362.638698:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.638787:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d0e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920362.639036:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171008 00000100:00100000:2.0:1790920362.639045:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171008 00000100:00100000:2.0:1790920362.639099:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790920362.639108:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972171008:12345-0@lo:503: 00000100:00100000:2.0:1790920362.639359:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972171008:12345-0@lo:503: Request processed in 252us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920362.639366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790920362.639613:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171008:0@lo:503: 00000100:00100000:3.0:1790920362.641228:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8473:1877915972171136:0@lo:502: 00000100:00100000:3.0:1790920362.641327:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.641376:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.641451:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171136 00000100:00100000:0.0:1790920362.641460:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171136 00000100:00100000:0.0:1790920362.641520:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790920362.641530:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:8473:x1877915972171136:12345-0@lo:502: 00000100:00100000:1.0:1790920362.642232:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:8473:x1877915972171136:12345-0@lo:502: Request processed in 700us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920362.642243:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790920362.642566:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8473:1877915972171136:0@lo:502: 00000020:01000000:0.0:1790920362.642615:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920362.642628:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920362.642630:0:8473:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790920362.642636:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790920362.642683:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8473:1877915972171264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920362.642727:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920362.643182:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920362.643464:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171264 00000100:00100000:1.0:1790920362.643473:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171264 00000100:00100000:1.0:1790920362.643526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790920362.643535:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:8473:x1877915972171264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920362.644147:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:8473:x1877915972171264:12345-0@lo:502:llog_process_th.0 Request processed in 610us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920362.644156:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790920362.644388:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8473:1877915972171264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790920362.644420:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920362.644426:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920362.644429:0:8473:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790920362.644434:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790920362.644627:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790920362.644988:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790920362.645004:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.645018:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920362.645030:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790920362.645033:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb05888000 from 39 10000000:01000000:3.0:1790920362.645037:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790920362.645076:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.645093:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.645104:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920362.645140:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.645192:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.645232:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a840 going to sleep for 11 seconds 00000100:00100000:1.0:1790920362.645320:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171392 00000100:00100000:1.0:1790920362.645327:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171392 00000100:00100000:1.0:1790920362.645372:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790920362.645381:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:5842:x1877915972171392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920362.645395:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920362.645411:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029efa00/0x2a4915844546a0ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a0e5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.645443:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029efa00/0x2a4915844546a0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a0e5 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.645455:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029efa00/0x2a4915844546a0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a0e5 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.645465:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029efa00, rc 0) 00000100:00100000:1.0:1790920362.645505:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972171392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920362.645512:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790920362.646260:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920362.646280:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920362.646290:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920362.646352:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920362.646389:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920362.646414:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f51cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.646537:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171520 00000100:00100000:3.0:1790920362.646542:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171520 00000100:00100000:3.0:1790920362.646582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790920362.646590:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972171520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.647182:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972171520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 591us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.647189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790920362.647342:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920362.647377:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790920362.647422:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920362.647452:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f51cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.648536:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171648 00000100:00100000:3.0:1790920362.648549:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171648 00000100:00100000:3.0:1790920362.648624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790920362.648633:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972171648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.649307:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972171648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 672us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.649315:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790920362.649440:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972171648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790920362.652298:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8474:1877915972171776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920362.652413:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920362.652467:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.652532:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171776 00000100:00100000:0.0:1790920362.652541:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171776 00000100:00100000:0.0:1790920362.652596:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790920362.652607:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:8474:x1877915972171776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920362.653267:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:8474:x1877915972171776:12345-0@lo:502:llog_process_th.0 Request processed in 658us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.653276:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790920362.653506:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8474:1877915972171776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920362.653572:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8474:1877915972171904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920362.653614:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920362.653666:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d406c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.653859:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972171904 00000100:00100000:3.0:1790920362.653865:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972171904 00000100:00100000:3.0:1790920362.653911:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790920362.653930:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:8474:x1877915972171904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920362.654120:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:8474:x1877915972171904:12345-0@lo:502:llog_process_th.0 Request processed in 192us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.654140:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790920362.654433:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8474:1877915972171904:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790920362.654455:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790920362.655026:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790920362.655046:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790920362.655057:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.655071:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920362.655082:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790920362.655085:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790920362.655088:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790920362.655134:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.655144:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.655155:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920362.655173:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.655319:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.655362:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.655448:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172032 00000100:00100000:0.0:1790920362.655454:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172032 00000100:00100000:0.0:1790920362.655490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790920362.655498:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:5842:x1877915972172032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790920362.655510:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920362.655525:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb00030200/0x2a4915844546a0fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a0f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.655573:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00030200/0x2a4915844546a0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a0f3 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.655586:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb00030200/0x2a4915844546a0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a0f3 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.655596:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00030200, rc 0) 00000100:00100000:0.0:1790920362.655636:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972172032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.655643:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790920362.656404:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920362.656436:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.656446:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920362.656517:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.656554:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.656589:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.656605:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172160 00000100:00100000:3.0:1790920362.656610:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172160 00000100:00100000:3.0:1790920362.656656:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790920362.656664:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972172160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.665207:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972172160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 8530us (8639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.665224:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790920362.665440:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.665511:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.665572:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920362.665616:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920362.666081:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172288 00000100:00100000:2.0:1790920362.666090:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172288 00000100:00100000:2.0:1790920362.666152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790920362.666163:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972172288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790920362.666413:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972172288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920362.666421:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790920362.666568:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920362.673023:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8475:1877915972172416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920362.673172:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.673236:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a46f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.673400:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172416 00000100:00100000:3.0:1790920362.673410:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172416 00000100:00100000:3.0:1790920362.673474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790920362.673484:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:8475:x1877915972172416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920362.673820:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:8475:x1877915972172416:12345-0@lo:502:llog_process_th.0 Request processed in 336us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.673828:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790920362.675142:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8475:1877915972172416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790920362.675194:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920362.675206:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920362.675209:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790920362.675230:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790920362.675275:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8475:1877915972172544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920362.675346:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.675383:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dc540 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.677494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172544 00000100:00100000:3.0:1790920362.677514:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172544 00000100:00100000:3.0:1790920362.677610:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790920362.677623:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:8475:x1877915972172544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920362.678345:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:8475:x1877915972172544:12345-0@lo:502:llog_process_th.0 Request processed in 723us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.678355:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790920362.678513:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8475:1877915972172544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790920362.678553:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920362.678561:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920362.678563:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790920362.678568:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1790920362.679002:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1790920362.679031:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790920362.679045:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.679058:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920362.679071:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790920362.679074:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb09ba1000 from 39 10000000:01000000:0.0:1790920362.679077:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790920362.679145:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.679154:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.679165:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920362.679191:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.679244:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920362.679279:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.680234:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172672 00000100:00100000:3.0:1790920362.680249:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172672 00000100:00100000:3.0:1790920362.680315:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790920362.680326:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972172672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920362.680344:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920362.680361:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421ce200/0x2a4915844546a108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a101 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.680392:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421ce200/0x2a4915844546a108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a101 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.680405:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421ce200/0x2a4915844546a108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a101 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.680415:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421ce200, rc 0) 00000100:00100000:3.0:1790920362.680496:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972172672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.680503:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790920362.680605:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920362.680626:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.680638:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920362.680729:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920362.680807:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.680837:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.681171:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172800 00000100:00100000:0.0:1790920362.681177:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172800 00000100:00100000:0.0:1790920362.681217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790920362.681225:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972172800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.681560:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972172800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.681566:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790920362.682021:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920362.682076:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920362.682136:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.682165:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.683485:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972172928 00000100:00100000:0.0:1790920362.683498:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972172928 00000100:00100000:0.0:1790920362.683547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790920362.683558:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972172928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.684375:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972172928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 815us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.684382:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790920362.684523:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972172928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920362.685495:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8476:1877915972173056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920362.685567:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.685606:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.686679:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173056 00000100:00100000:3.0:1790920362.686693:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173056 00000100:00100000:3.0:1790920362.686804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790920362.686815:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8476:x1877915972173056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920362.687474:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8476:x1877915972173056:12345-0@lo:502:llog_process_th.0 Request processed in 659us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.687494:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790920362.688688:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8476:1877915972173056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920362.688818:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8476:1877915972173184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920362.688924:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920362.688972:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2540 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.691401:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173184 00000100:00100000:3.0:1790920362.691422:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173184 00000100:00100000:3.0:1790920362.691522:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790920362.691536:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8476:x1877915972173184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920362.691986:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8476:x1877915972173184:12345-0@lo:502:llog_process_th.0 Request processed in 453us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.691996:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790920362.692232:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8476:1877915972173184:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790920362.692275:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790920362.692487:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790920362.692509:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790920362.692522:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.692535:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920362.692548:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790920362.692551:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1790920362.692555:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790920362.692593:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.693948:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.693976:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920362.694013:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.694110:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.694177:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.694206:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173312 00000100:00100000:3.0:1790920362.694226:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173312 00000100:00100000:3.0:1790920362.694289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790920362.694300:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972173312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920362.694315:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920362.694333:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421cf400/0x2a4915844546a116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a10f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.694364:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421cf400/0x2a4915844546a116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a10f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.694375:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421cf400/0x2a4915844546a116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a10f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.694384:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421cf400, rc 0) 00000100:00100000:3.0:1790920362.694424:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972173312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.694431:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790920362.694478:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920362.694493:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.694502:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920362.694566:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.694600:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.694613:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.694623:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173440 00000100:00100000:3.0:1790920362.694627:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173440 00000100:00100000:3.0:1790920362.694644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790920362.694649:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972173440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.696439:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972173440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1780us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.696453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790920362.700136:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.700449:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.700558:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.700615:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720af00 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.700691:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173568 00000100:00100000:0.0:1790920362.700701:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173568 00000100:00100000:0.0:1790920362.700795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790920362.700807:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972173568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.701583:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972173568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 774us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.701593:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790920362.701809:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920362.702542:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8477:1877915972173696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920362.702609:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.702665:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dc900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920362.702718:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173696 00000100:00100000:3.0:1790920362.702725:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173696 00000100:00100000:3.0:1790920362.702793:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790920362.702803:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8477:x1877915972173696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920362.703051:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8477:x1877915972173696:12345-0@lo:502:llog_process_th.0 Request processed in 248us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.703058:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790920362.703242:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8477:1877915972173696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790920362.703275:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920362.703287:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920362.703290:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790920362.703297:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790920362.703320:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8477:1877915972173824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920362.703355:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.703373:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.703468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173824 00000100:00100000:0.0:1790920362.703474:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173824 00000100:00100000:0.0:1790920362.703495:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790920362.703501:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8477:x1877915972173824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920362.703650:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8477:x1877915972173824:12345-0@lo:502:llog_process_th.0 Request processed in 148us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.703657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790920362.703835:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8477:1877915972173824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790920362.703862:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920362.703867:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920362.703868:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790920362.703872:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1790920362.704171:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1790920362.704193:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790920362.704205:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.704228:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920362.704249:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790920362.704252:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88eb05f10000 from 1 10000000:01000000:3.0:1790920362.704255:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790920362.704284:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.704293:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.704303:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920362.704319:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920362.704356:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920362.704389:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.704478:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972173952 00000100:00100000:0.0:1790920362.704484:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972173952 00000100:00100000:0.0:1790920362.704519:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790920362.704527:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972173952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790920362.704538:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920362.704553:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb00030800/0x2a4915844546a124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a11d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.704577:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00030800/0x2a4915844546a124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a11d expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.704601:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb00030800/0x2a4915844546a124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a11d expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.704611:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00030800, rc 0) 00000100:00100000:0.0:1790920362.704663:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972173952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.704670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790920362.708502:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972173952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920362.708544:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a124 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.708584:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a124 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920362.708700:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972174080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920362.708794:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920362.708836:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920362.709014:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972174080 00000100:00100000:0.0:1790920362.709021:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972174080 00000100:00100000:0.0:1790920362.709063:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790920362.709071:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972174080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.709398:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972174080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (603us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790920362.709407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790920362.710636:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972174080:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790920362.710700:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790920362.710713:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a124 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920362.710724:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a124 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920362.891715:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920362.892478:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174400 00000100:00100000:0.0:1790920362.892492:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174400 00000100:00100000:0.0:1790920362.892563:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:0.0:1790920362.892573:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:5595:x1877915951174400:12345-192.168.204.34@tcp:101: 00010000:00010000:0.0:1790920362.892593:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920362.892613:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb00030a00/0x2a4915844546a12b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda9cf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.892658:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00030a00/0x2a4915844546a12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9cf expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.892670:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb00030a00/0x2a4915844546a12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9cf expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920362.892701:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00030a00, rc 0) 00000100:00100000:0.0:1790920362.892794:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5595:x1877915951174400:12345-192.168.204.34@tcp:101: Request processed in 223us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.892811:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:3.0:1790920362.915467:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920362.917456:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174528 00000100:00100000:0.0:1790920362.917476:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174528 00000100:00100000:0.0:1790920362.917574:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:0.0:1790920362.917585:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5595:x1877915951174528:12345-192.168.204.34@tcp:501: 00000100:00100000:0.0:1790920362.918383:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5595:x1877915951174528:12345-192.168.204.34@tcp:501: Request processed in 796us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.918392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:1.0:1790920362.923366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920362.923531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174656 00000100:00100000:3.0:1790920362.923557:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174656 00000100:00100000:3.0:1790920362.923627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:3.0:1790920362.923638:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5595:x1877915951174656:12345-192.168.204.34@tcp:503: 00000100:00100000:3.0:1790920362.923993:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5595:x1877915951174656:12345-192.168.204.34@tcp:503: Request processed in 356us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.924002:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:1.0:1790920362.935168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920362.947939:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174784 00000100:00100000:0.0:1790920362.947960:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174784 00000100:00100000:0.0:1790920362.948044:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:0.0:1790920362.948055:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:6069:x1877915951174784:12345-192.168.204.34@tcp:502: 00000100:00100000:0.0:1790920362.948460:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:6069:x1877915951174784:12345-192.168.204.34@tcp:502: Request processed in 403us (13305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.948467:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:1.0:1790920362.953419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920362.954816:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951174912 00000100:00100000:0.0:1790920362.954852:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951174912 00000100:00100000:0.0:1790920362.954942:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:0.0:1790920362.954954:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:6069:x1877915951174912:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790920362.956031:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:6069:x1877915951174912:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 1069us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920362.956062:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:1.0:1790920362.965317:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920362.966476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175040 00000100:00100000:3.0:1790920362.966491:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175040 00000100:00100000:3.0:1790920362.966566:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:3.0:1790920362.966577:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5595:x1877915951175040:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920362.966616:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920362.966703:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb421cfc00/0x2a4915844546a132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda9d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.966970:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb421cfc00/0x2a4915844546a132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9d6 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.966984:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb421cfc00/0x2a4915844546a132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9d6 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920362.966994:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421cfc00, rc 0) 00000100:00100000:3.0:1790920362.967152:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175040:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 568us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920362.967160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:1.0:1790920362.974742:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920362.975409:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175168 00000100:00100000:0.0:1790920362.975423:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175168 00000100:00100000:0.0:1790920362.975493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 172 00000100:00100000:0.0:1790920362.975505:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175168:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920362.976397:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175168:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 889us (1676us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790920362.976408:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 172 00010000:00010000:0.0:1790920363.050126:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920364.085999:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920364.137075:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972174464:0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.137172:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972174208:0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.137221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920364.137259:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972174336:0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.137275:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972174720:0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.137300:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920364.137349:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972174592:0@lo:400:kworker.0 00000100:00100000:0.0:1790920364.137372:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920364.137388:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920364.137401:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972174848:0@lo:400:kworker.0 00000100:00100000:0.0:1790920364.137431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920364.137462:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972174208 00000100:00100000:2.0:1790920364.137471:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972174208 00000100:00100000:0.0:1790920364.137478:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972174720 00000100:00100000:0.0:1790920364.137484:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972174720 00000100:00100000:0.0:1790920364.137537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972174336 00000100:00100000:0.0:1790920364.137540:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972174336 00000100:00100000:2.0:1790920364.137544:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790920364.137558:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972174208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920364.137562:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790920364.137573:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972174720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.137632:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972174208:12345-0@lo:400:kworker.0 Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920364.137634:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972174720:12345-0@lo:400:kworker.0 Request processed in 62us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920364.137647:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1790920364.137648:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790920364.137671:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790920364.137680:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972174336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.137692:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972174592 00000100:00100000:2.0:1790920364.137698:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972174592 00000100:00100000:2.0:1790920364.137731:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972174848 00000100:00100000:2.0:1790920364.137734:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972174848 00000100:00100000:0.0:1790920364.137738:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972174336:12345-0@lo:400:kworker.0 Request processed in 58us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920364.137780:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790920364.137788:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920364.137796:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972174592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920364.137810:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790920364.137822:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972174848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.137834:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972174592:12345-0@lo:400:kworker.0 Request processed in 38us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920364.137841:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790920364.137862:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972174848:12345-0@lo:400:kworker.0 Request processed in 43us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920364.137870:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790920364.137896:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920364.137902:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920364.137906:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920364.137944:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972174336:0@lo:400:kworker.0 00010000:00080000:0.0:1790920364.137960:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629180 x1877915972174848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920364.137970:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972174848:0@lo:400:kworker.0 00000100:00100000:1.0:1790920364.138052:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790920364.138198:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05629c00 x1877915972174592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920364.138209:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972174592:0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.138230:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972174208:0@lo:400:kworker.0 00000100:00100000:2.0:1790920364.138239:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972174720:0@lo:400:kworker.0 00000100:00100000:0.0:1790920364.138500:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972174464 00000100:00100000:0.0:1790920364.138508:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972174464 00000100:00100000:0.0:1790920364.138613:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790920364.138622:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972174464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920364.138676:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972174464:12345-0@lo:400:kworker.0 Request processed in 55us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920364.138683:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790920364.138717:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972174464:0@lo:400:kworker.0 00000100:00080000:1.0:1790920364.138791:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1790920364.412041:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef04390c0 20000000:00000080:0.0:1790920364.412060:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88eb41c5a800 uarg=0000000000000000 20000000:01000000:0.0:1790920364.412125:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790920364.412132:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790920364.412137:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790920364.413107:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1790920364.413271:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1790920364.417717:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1790920364.417825:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1790920364.417878:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1790920364.417896:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790920364.417922:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.417944:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb421cf200/0x2a49158445469eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469ea7 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.417953:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469f09 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.417960:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a49158445469fd4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.417971:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.417978:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.418023:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.418039:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 9 pid: 5839 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920364.418071:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972174976:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920364.418198:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469fd4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.418206:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469fd4 expref: 18 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920364.418216:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972175104:0@lo:104: 00000100:00100000:0.0:1790920364.418258:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790920364.418291:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469f09 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.418300:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469f09 expref: 18 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920364.418308:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972175232:0@lo:104: 00000100:00100000:0.0:1790920364.418331:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790920364.418355:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb421cf200/0x2a49158445469eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a49158445469ea7 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920364.418363:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb421cf200/0x2a49158445469eae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a49158445469ea7 expref: 18 pid: 5840 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920364.418371:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972175360:0@lo:104: 00000100:00100000:0.0:1790920364.418388:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920364.418475:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790920364.418496:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920364.418508:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972175104 00000100:00100000:1.0:1790920364.418523:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972175104 00000100:00100000:1.0:1790920364.418567:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972175232 00000100:00100000:1.0:1790920364.418570:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972175232 00000100:00100000:1.0:1790920364.418580:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972175360 00000100:00100000:1.0:1790920364.418582:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972175360 00000100:00100000:1.0:1790920364.418595:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790920364.418604:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:8515:x1877915972175104:12345-0@lo:104: 00010000:00010000:1.0:1790920364.418618:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.418681:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790920364.418688:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:8515:x1877915972175104:12345-0@lo:104: Request processed in 85us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.418696:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790920364.418715:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790920364.418720:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:8515:x1877915972175232:12345-0@lo:104: 00010000:00010000:1.0:1790920364.418728:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.418796:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790920364.418802:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:8515:x1877915972175232:12345-0@lo:104: Request processed in 81us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.418808:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790920364.418847:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790920364.418853:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:8515:x1877915972175360:12345-0@lo:104: 00010000:00010000:1.0:1790920364.418861:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.418885:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790920364.418896:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:8515:x1877915972175360:12345-0@lo:104: Request processed in 43us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.418902:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790920364.418920:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790920364.418928:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.418937:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031200 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920364.418941:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.418951:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920364.418959:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920364.418966:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790920364.418995:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419001:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920364.419022:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419030:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00031200/0x2a49158445469fd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469fdb expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419043:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790920364.419046:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419063:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030c00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920364.419065:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419073:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920364.419079:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920364.419084:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790920364.419111:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419117:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920364.419123:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419130:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00030c00/0x2a49158445469f09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469f10 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419140:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920364.419143:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419150:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920364.419152:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419169:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920364.419175:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920364.419181:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790920364.419192:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419197:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920364.419212:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419218:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a49158445469ea7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a49158445469eae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419231:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920364.419232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920364.419234:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920364.419240:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920364.419258:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972175488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920364.419286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920364.419309:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920364.419315:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972175616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920364.419347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920364.419376:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972175744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920364.419396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920364.419436:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972175488 00000100:00100000:1.0:1790920364.419441:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972175488 00010000:00010000:1.0:1790920364.419460:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469fd4 expref: 19 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920364.419480:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972175616 00000100:00100000:1.0:1790920364.419483:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972175616 00010000:00010000:1.0:1790920364.419494:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f09 expref: 20 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920364.419504:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972175744 00000100:00100000:1.0:1790920364.419506:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972175744 00010000:00010000:1.0:1790920364.419516:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb421cf200/0x2a49158445469eae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469ea7 expref: 21 pid: 5840 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920364.419528:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790920364.419534:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+21:3306:x1877915972175488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790920364.419544:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920364.419549:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469fd4 expref: 21 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419558:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469fd4 expref: 21 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419573:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920364.419599:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+21:3306:x1877915972175488:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.419605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790920364.419617:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790920364.419623:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+20:3306:x1877915972175616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790920364.419639:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920364.419644:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469f09 expref: 20 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419652:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469f09 expref: 20 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419662:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920364.419682:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+20:3306:x1877915972175616:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.419688:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790920364.419699:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790920364.419705:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972175744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790920364.419712:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920364.419716:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb421cf200/0x2a49158445469eae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a49158445469ea7 expref: 19 pid: 5840 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419724:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb421cf200/0x2a49158445469eae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a49158445469ea7 expref: 19 pid: 5840 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.419733:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920364.419778:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972175744:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.419785:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790920364.419826:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972175744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920364.419850:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972175616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920364.419857:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972175488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920364.420495:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56a800/0x2a49158445469fdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469fd4 expref: 18 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920364.420521:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972175104:0@lo:104: 00010000:00010000:0.0:1790920364.420546:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139cc00/0x2a49158445469f10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469f09 expref: 17 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920364.420556:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972175232:0@lo:104: 00010000:00010000:0.0:1790920364.420567:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421cf200/0x2a49158445469eae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a49158445469ea7 expref: 16 pid: 5840 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920364.420574:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972175360:0@lo:104: 00000100:00100000:2.0:1790920364.426778:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920364.426896:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877915972174976:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920364.426947:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920364.427135:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175296 00000100:00100000:1.0:1790920364.427145:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175296 00010000:00010000:1.0:1790920364.427187:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 10 pid: 5839 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920364.427229:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:1.0:1790920364.427239:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951175296:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920364.427256:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920364.427262:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 10 pid: 5839 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427274:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 10 pid: 5839 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427294:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a098 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda99e expref: 10 pid: 5839 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427311:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427320:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427337:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427344:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427352:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427371:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427378:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920364.427382:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427391:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427413:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920364.427423:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920364.427476:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:2354:x1877915951175296:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 238us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.427484:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00010000:00010000:3.0:1790920364.427683:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920364.427692:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920364.427709:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00031c00/0x2a4915844546a139 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920364.434967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920364.435059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175424 00000100:00100000:3.0:1790920364.435071:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175424 00000100:00100000:3.0:1790920364.435154:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:3.0:1790920364.435164:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:5595:x1877915951175424:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920364.435183:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920364.435209:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda9dd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920364.435239:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920364.435251:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920364.435259:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37c00, rc 0) 00000100:00100000:3.0:1790920364.435327:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175424:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 164us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920364.435333:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:1.0:1790920364.440068:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920364.440143:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175552 00000100:00100000:2.0:1790920364.440157:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175552 00000100:00100000:2.0:1790920364.440219:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:2.0:1790920364.440231:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175552:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920364.440776:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175552:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 545us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920364.440786:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:1.0:1790920364.452721:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920364.452891:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175680 00000100:00100000:0.0:1790920364.452905:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175680 00000100:00100000:0.0:1790920364.452975:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 176 00000100:00100000:0.0:1790920364.452992:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175680:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920364.453274:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:5595:x1877915951175680:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 284us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920364.453282:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 176 00000100:00100000:1.0:1790920364.463258:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920364.463339:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175808 00000100:00100000:3.0:1790920364.463351:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175808 00000100:00100000:3.0:1790920364.463413:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 177 00000100:00100000:3.0:1790920364.463426:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:6086:x1877915951175808:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790920364.463695:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:6086:x1877915951175808:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 271us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920364.463704:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 177 00000100:00100000:1.0:1790920364.469954:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920364.470134:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951175936 00000100:00100000:0.0:1790920364.470148:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951175936 00000100:00100000:0.0:1790920364.470216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 178 00000100:00100000:0.0:1790920364.470227:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:6086:x1877915951175936:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790920364.470494:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:6086:x1877915951175936:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 268us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920364.470508:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 178 00000100:00100000:2.0:1790920364.650970:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972175872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920364.651060:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920364.651644:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972175872 00000100:00100000:2.0:1790920364.651654:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972175872 00000100:00100000:3.0:1790920364.652569:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790920364.652629:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972175872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790920364.652670:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920364.652742:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972175872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920364.652770:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790920364.652991:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41824e00 x1877915972175872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920364.653018:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972175872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920364.691912:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920364.691967:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920364.692007:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920364.692158:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176320 00000100:00100000:1.0:1790920364.692171:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176320 00000100:00100000:1.0:1790920364.692249:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176192 00000100:00100000:1.0:1790920364.692252:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176192 00000100:00100000:1.0:1790920364.692280:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:1.0:1790920364.692290:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951176320:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920364.692369:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951176320:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 80us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.692389:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:1.0:1790920364.692408:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:1.0:1790920364.692414:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951176192:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920364.692440:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951176192:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920364.692446:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00080000:2.0:1790920364.693042:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920364.693048:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790920364.693355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176064 00000100:00100000:0.0:1790920364.693362:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176064 00000100:00100000:0.0:1790920364.693465:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:0.0:1790920364.693474:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951176064:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920364.693531:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951176064:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 58us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920364.693539:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00080000:2.0:1790920364.695613:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790920365.108476:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790920365.871438:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790920365.871452:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3a4ce000 from 4 10000000:01000000:3.0:1790920365.871458:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790920365.871521:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.871534:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.871546:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920365.871575:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.871648:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.871817:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920365.879571:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176000 00000100:00100000:2.0:1790920365.879590:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176000 00000100:00100000:2.0:1790920365.879667:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790920365.879691:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972176000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920365.879716:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920365.879742:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a147 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920365.879810:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a147 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920365.879824:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a147 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920365.879835:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a600, rc 0) 00000100:00100000:2.0:1790920365.879933:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972176000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (8284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920365.879940:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790920365.880273:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920365.880292:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.880301:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920365.880378:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.880412:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.880448:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.880463:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176128 00000100:00100000:3.0:1790920365.880467:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176128 00000100:00100000:3.0:1790920365.880493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790920365.880500:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972176128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.883207:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972176128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2699us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.883229:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790920365.885963:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920365.886233:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920365.886311:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920365.886356:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb061d56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.887479:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176256 00000100:00100000:3.0:1790920365.887491:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176256 00000100:00100000:3.0:1790920365.887546:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790920365.887557:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972176256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.887854:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972176256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 298us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.887863:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790920365.888527:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920365.889387:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8566:1877915972176384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920365.889451:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920365.889492:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb061d56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920365.889536:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176384 00000100:00100000:0.0:1790920365.889542:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176384 00000100:00100000:0.0:1790920365.889617:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790920365.889627:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8566:x1877915972176384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920365.889872:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8566:x1877915972176384:12345-0@lo:502:llog_process_th.0 Request processed in 246us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920365.889880:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790920365.889973:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8566:1877915972176384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790920365.890004:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920365.890013:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920365.890016:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790920365.890023:0:8566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb3a4ce000 00000020:00000080:1.0:1790920365.890026:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790920365.890114:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8566:1877915972176512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920365.890148:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920365.890714:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb106a5780 going to sleep for 11 seconds 00000100:00100000:2.0:1790920365.893297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176512 00000100:00100000:2.0:1790920365.893315:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176512 00000100:00100000:2.0:1790920365.893369:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790920365.893379:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8566:x1877915972176512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920365.893646:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:8566:x1877915972176512:12345-0@lo:502:llog_process_th.0 Request processed in 268us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920365.893655:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790920365.895394:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8566:1877915972176512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790920365.895448:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920365.895456:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920365.895458:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790920365.895462:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790920365.895621:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790920365.895643:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790920365.895654:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920365.895666:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920365.895733:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790920365.895736:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb05888000 from 4 10000000:01000000:0.0:1790920365.895773:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920365.895812:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920365.895821:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920365.895831:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920365.895855:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790920365.895910:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920365.895947:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2600 going to sleep for 11 seconds 00000100:00100000:1.0:1790920365.896340:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176640 00000100:00100000:1.0:1790920365.896347:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176640 00000100:00100000:1.0:1790920365.896395:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790920365.896404:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972176640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920365.896416:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920365.896429:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a155 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920365.896453:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a155 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920365.896463:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a155 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920365.896471:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029ef200, rc 0) 00000100:00100000:1.0:1790920365.896512:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972176640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920365.896518:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790920365.896620:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790920365.896634:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920365.896642:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920365.896792:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920365.896820:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920365.896841:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2600 going to sleep for 11 seconds 00000100:00100000:1.0:1790920365.897792:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176768 00000100:00100000:1.0:1790920365.897800:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176768 00000100:00100000:1.0:1790920365.897838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790920365.897846:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972176768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920365.902153:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972176768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4297us (5321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920365.902184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790920365.902414:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920365.902478:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920365.902536:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920365.902579:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.903393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972176896 00000100:00100000:3.0:1790920365.903404:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972176896 00000100:00100000:3.0:1790920365.914049:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790920365.914081:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972176896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.914355:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972176896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 294us (11818us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.914364:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790920365.914430:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972176896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.914645:0:8569:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8569:1877915972177024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.914707:0:8569:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.914733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177024 00000100:00100000:3.0:1790920365.914739:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177024 00000100:00100000:3.0:1790920365.914790:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790920365.914796:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8569:x1877915972177024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.914920:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8569:x1877915972177024:12345-0@lo:502:llog_process_th.0 Request processed in 123us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.914935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790920365.914975:0:8569:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.914985:0:8569:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8569:1877915972177024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790920365.915006:0:8569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920365.915015:0:8569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920365.915017:0:8569:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790920365.915024:0:8569:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb05888000 00000020:00000080:3.0:1790920365.915026:0:8569:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790920365.915522:0:8569:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8569:1877915972177152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.915557:0:8569:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.915578:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177152 00000100:00100000:3.0:1790920365.915582:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177152 00000100:00100000:3.0:1790920365.915604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790920365.915610:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8569:x1877915972177152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.915725:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:8569:x1877915972177152:12345-0@lo:502:llog_process_th.0 Request processed in 115us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.915733:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790920365.915778:0:8569:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.915788:0:8569:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8569:1877915972177152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790920365.915806:0:8569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920365.915811:0:8569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920365.915813:0:8569:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790920365.915817:0:8569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790920365.915864:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790920365.915883:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790920365.915893:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.915910:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920365.915921:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790920365.915924:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb09ba1000 from 4 10000000:01000000:3.0:1790920365.915927:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790920365.915951:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.915958:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.915968:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920365.915979:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972177280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.916003:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.916014:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.916024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177280 00000100:00100000:3.0:1790920365.916027:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177280 00000100:00100000:3.0:1790920365.916044:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790920365.916049:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972177280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920365.916071:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920365.916083:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a163 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.916103:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a163 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.916124:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a163 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.916133:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36800, rc 0) 00000100:00100000:3.0:1790920365.916157:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972177280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.916162:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790920365.916188:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972177280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920365.916199:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.916207:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920365.916246:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972177408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.916269:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.916279:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.916288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177408 00000100:00100000:3.0:1790920365.916291:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177408 00000100:00100000:3.0:1790920365.916307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790920365.916312:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972177408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.916490:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972177408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.916496:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790920365.916520:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972177408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.916548:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972177536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.916576:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.916587:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f94a900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.916596:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177536 00000100:00100000:3.0:1790920365.916599:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177536 00000100:00100000:3.0:1790920365.916615:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790920365.916620:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972177536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.916724:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972177536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.916730:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790920365.927027:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972177536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920365.927289:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8570:1877915972177664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.927367:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.927404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177664 00000100:00100000:3.0:1790920365.927410:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177664 00000100:00100000:3.0:1790920365.927453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790920365.927462:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:8570:x1877915972177664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.928175:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:8570:x1877915972177664:12345-0@lo:502:llog_process_th.0 Request processed in 712us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.928183:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790920365.928234:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.928252:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8570:1877915972177664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790920365.928280:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920365.928289:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920365.928297:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790920365.928304:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb09ba1000 00000020:00000080:3.0:1790920365.928306:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790920365.929834:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8570:1877915972177792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.930008:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920365.930048:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177792 00000100:00100000:3.0:1790920365.930056:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177792 00000100:00100000:3.0:1790920365.931216:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790920365.931230:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:8570:x1877915972177792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920365.931482:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:8570:x1877915972177792:12345-0@lo:502:llog_process_th.0 Request processed in 255us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920365.931490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790920365.931541:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920365.931566:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:8570:1877915972177792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790920365.931601:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920365.931609:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920365.931611:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790920365.931616:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790920365.932053:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790920365.932091:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790920365.932104:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920365.932117:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920366.121332:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920366.186268:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972177920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920366.186352:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920366.186459:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972177920 00000100:00100000:3.0:1790920366.186469:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972177920 00000100:00100000:3.0:1790920366.186540:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790920366.186552:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972177920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920366.186597:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920366.186649:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972177920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920366.186656:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1790920366.187244:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790920366.187285:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34253100 x1877915972177920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920366.187307:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972177920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790920367.145255:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920368.173407:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920369.197385:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920369.258500:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972178048:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.258597:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920369.258657:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972178560:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.258685:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920369.258713:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790920369.258719:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972178432:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.258741:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920369.260338:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972178176:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.260383:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920369.260410:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972178688:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.260434:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920369.260467:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920369.260474:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972178304:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.260496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920369.260531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178048 00000100:00100000:1.0:1790920369.260540:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178048 00000100:00100000:1.0:1790920369.260599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1790920369.260621:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.260680:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972178048:12345-0@lo:400:kworker.0 Request processed in 73us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.260688:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1790920369.260723:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178560 00000100:00100000:1.0:1790920369.260741:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178560 00000100:00100000:1.0:1790920369.260796:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178176 00000100:00100000:1.0:1790920369.260799:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178176 00000100:00100000:1.0:1790920369.260810:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178304 00000100:00100000:1.0:1790920369.260812:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178304 00000100:00100000:1.0:1790920369.260824:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790920369.260831:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972178560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.260864:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972178560:12345-0@lo:400:kworker.0 Request processed in 35us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.260871:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790920369.260883:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790920369.260889:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972178176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.260922:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972178176:12345-0@lo:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.260928:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790920369.260940:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790920369.260946:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972178304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.260972:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972178304:12345-0@lo:400:kworker.0 Request processed in 26us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.260977:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790920369.261008:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178432 00000100:00100000:1.0:1790920369.261012:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178432 00000100:00100000:1.0:1790920369.261039:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178688 00000100:00100000:1.0:1790920369.261042:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178688 00000100:00100000:1.0:1790920369.261070:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790920369.261077:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972178432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.261110:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972178432:12345-0@lo:400:kworker.0 Request processed in 34us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.261124:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790920369.261136:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790920369.261142:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972178688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.261170:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972178688:12345-0@lo:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.261176:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790920369.261216:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972178304:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.261225:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972178176:0@lo:400:kworker.0 00010000:00080000:1.0:1790920369.261236:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d32680 x1877915972178688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920369.261246:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972178688:0@lo:400:kworker.0 00010000:00080000:1.0:1790920369.261365:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d31500 x1877915972178432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920369.261375:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972178432:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.261384:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972178048:0@lo:400:kworker.0 00000100:00100000:1.0:1790920369.261395:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972178560:0@lo:400:kworker.0 00000100:00080000:2.0:1790920369.263437:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920369.263448:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920369.263451:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920369.782092:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972178816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920369.782173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920369.782262:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178816 00000100:00100000:1.0:1790920369.782271:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178816 00000100:00100000:1.0:1790920369.782327:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790920369.782336:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972178816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790920369.782383:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920369.782434:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972178816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.782442:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790920369.782503:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34253100 x1877915972178816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920369.782524:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972178816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920369.813842:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920369.813927:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176448 00000100:00100000:1.0:1790920369.813938:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176448 00000100:00100000:1.0:1790920369.814951:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:1.0:1790920369.814965:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951176448:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920369.815729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920369.815802:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920369.815834:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920369.816402:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951176448:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 1436us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.816419:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:1.0:1790920369.816901:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176704 00000100:00100000:1.0:1790920369.816910:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176704 00000100:00100000:1.0:1790920369.816973:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176832 00000100:00080000:0.0:1790920369.816974:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920369.816977:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176832 00000100:00080000:0.0:1790920369.817009:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920369.817026:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1790920369.817036:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951176704:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920369.817083:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951176704:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 48us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.817090:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1790920369.817105:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1790920369.817111:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951176832:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920369.817144:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951176832:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 33us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.817150:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1790920369.817172:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176576 00000100:00100000:1.0:1790920369.817175:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176576 00000100:00100000:1.0:1790920369.817217:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00080000:0.0:1790920369.817232:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920369.819820:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951176576:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920369.821931:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951176576:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 4693us (6114us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920369.821949:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00010000:00010000:1.0:1790920370.220776:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920371.242060:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920371.307003:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972178944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920371.307099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920371.307407:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972178944 00000100:00100000:3.0:1790920371.307417:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972178944 00000100:00100000:3.0:1790920371.307489:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790920371.307502:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972178944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920371.307542:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920371.307595:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972178944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920371.307603:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790920371.308197:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790920371.308241:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34250700 x1877915972178944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920371.308262:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972178944:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1790920371.386375:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1790920372.265917:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920373.301410:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920374.313252:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920374.377436:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972179456:0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.377534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920374.377714:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972179328:0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.377738:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790920374.377764:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972179072:0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.377799:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920374.377845:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972179584:0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.377870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920374.377933:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972179200:0@lo:400:kworker.0 00000100:00100000:2.0:1790920374.377987:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179072 00000100:00100000:2.0:1790920374.377996:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179072 00000100:00100000:2.0:1790920374.378046:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1790920374.378056:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972179072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920374.378084:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179456 00000100:00100000:3.0:1790920374.378088:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179456 00000100:00100000:2.0:1790920374.378219:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972179072:12345-0@lo:400:kworker.0 Request processed in 162us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920374.378227:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:2.0:1790920374.378268:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920374.385935:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972179072:0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.386004:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920374.388794:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920374.388829:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972179456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920374.388983:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972179456:12345-0@lo:400:kworker.0 Request processed in 174us (11449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920374.388991:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790920374.391258:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179584 00000100:00100000:2.0:1790920374.391275:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179584 00010000:00080000:0.0:1790920374.391287:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d30380 x1877915972179456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920374.391309:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972179456:0@lo:400:kworker.0 00000100:00100000:2.0:1790920374.391405:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790920374.391415:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972179584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920374.391533:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972179584:12345-0@lo:400:kworker.0 Request processed in 119us (13662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920374.391541:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790920374.391584:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972179584:0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.391915:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972179712:0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.391960:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920374.392000:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179712 00000100:00100000:1.0:1790920374.392004:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179712 00000100:00100000:2.0:1790920374.392111:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179200 00000100:00100000:2.0:1790920374.392116:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179200 00000100:00100000:2.0:1790920374.392147:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790920374.392154:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972179200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920374.392192:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972179200:12345-0@lo:400:kworker.0 Request processed in 39us (6188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920374.392199:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790920374.392218:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920374.392228:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179328 00000100:00100000:2.0:1790920374.392231:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179328 00000100:00100000:0.0:1790920374.392279:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972179200:0@lo:400:kworker.0 00000100:00080000:3.0:1790920374.396841:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920374.397368:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920374.399230:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790920374.399250:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972179712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920374.399385:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972179712:12345-0@lo:400:kworker.0 Request processed in 143us (7422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920374.399392:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1790920374.400211:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d31c00 x1877915972179712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920374.400231:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972179712:0@lo:400:kworker.0 00000100:00100000:2.0:1790920374.402146:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790920374.402162:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972179328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920374.402309:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972179328:12345-0@lo:400:kworker.0 Request processed in 150us (10089us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920374.402318:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790920374.402658:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972179328:0@lo:400:kworker.0 00000100:00100000:2.0:1790920374.897878:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920374.899372:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972179840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920374.899462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920374.901638:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179840 00000100:00100000:3.0:1790920374.901654:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179840 00000100:00100000:3.0:1790920374.901732:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790920374.901743:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972179840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790920374.901809:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920374.906611:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972179840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4857us (7136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920374.906719:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1790920374.914987:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41827800 x1877915972179840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920374.915019:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972179840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920374.933026:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920374.933098:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920374.933176:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177088 00000100:00100000:0.0:1790920374.933189:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177088 00000100:00100000:0.0:1790920374.933297:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:0.0:1790920374.933310:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951177088:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920374.933388:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951176960 00000100:00100000:1.0:1790920374.933393:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951176960 00000100:00100000:0.0:1790920374.933407:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951177088:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 97us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920374.933416:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:1.0:1790920374.933436:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 197 00000100:00100000:1.0:1790920374.933459:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951176960:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920374.933493:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951176960:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 50us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920374.933514:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 197 00000100:00080000:3.0:1790920374.934842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920374.955352:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920374.955402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920374.955480:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177216 00000100:00100000:1.0:1790920374.955483:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177344 00000100:00100000:3.0:1790920374.955494:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177216 00000100:00100000:1.0:1790920374.955494:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177344 00000100:00100000:1.0:1790920374.955580:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00080000:0.0:1790920374.955592:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920374.955594:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2351:x1877915951177344:12345-192.168.204.34@tcp:9:kworker.0 00000100:00080000:0.0:1790920374.955599:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1790920374.955640:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a0ad 00000100:00080000:1.0:1790920374.955652:0:6688:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4fb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790920374.955719:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790920374.956140:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+2:2351:x1877915951177344:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 548us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920374.956149:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1790920374.956167:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:1.0:1790920374.956174:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2351:x1877915951177216:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:1.0:1790920374.956191:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a0a6 00000100:00080000:1.0:1790920374.956197:0:6688:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4ff800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790920374.956220:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790920374.956442:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+2:2351:x1877915951177216:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 267us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920374.956449:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00010000:00010000:0.0:1790920374.956522:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920374.957809:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920375.337146:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920376.361509:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920376.425696:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920376.425729:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972179968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920376.425869:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920376.425971:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972179968 00000100:00100000:0.0:1790920376.425991:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972179968 00000100:00100000:0.0:1790920376.426066:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790920376.426079:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972179968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790920376.426125:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920376.426180:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972179968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920376.426187:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790920376.426235:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34253b80 x1877915972179968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920376.426256:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972179968:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790920376.426706:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790920377.384931:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790920378.357158:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing yml_node 00010000:00010000:3.0:1790920378.410183:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920379.433919:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920379.498921:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972180096:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.499195:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920379.499249:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972180608:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.499278:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920379.499305:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920379.499310:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972180480:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.499337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920379.499369:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972180224:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.499391:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920379.499406:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972180736:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.499426:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920379.499445:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920379.499451:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972180352:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.499470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920379.499513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180096 00000100:00100000:0.0:1790920379.499524:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180096 00000100:00100000:0.0:1790920379.499575:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790920379.499695:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180608 00000100:00100000:1.0:1790920379.499700:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180608 00000100:00100000:1.0:1790920379.499736:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180224 00000100:00100000:1.0:1790920379.499739:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180224 00000100:00100000:1.0:1790920379.499774:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180352 00000100:00100000:1.0:1790920379.499777:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180352 00000100:00100000:1.0:1790920379.499793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790920379.499813:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972180608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.499879:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972180608:12345-0@lo:400:kworker.0 Request processed in 68us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920379.499886:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790920379.499906:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790920379.499911:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972180224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.499941:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972180224:12345-0@lo:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920379.499955:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790920379.499968:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790920379.499974:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972180352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.500001:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972180352:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920379.500007:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1790920379.500027:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920379.500063:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972180608:0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.500094:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972180352:0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.500103:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972180224:0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.500155:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180480 00000100:00100000:1.0:1790920379.500160:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180480 00000100:00100000:1.0:1790920379.500189:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180736 00000100:00100000:1.0:1790920379.500193:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180736 00000100:00100000:1.0:1790920379.500215:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790920379.500222:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972180480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.500258:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972180480:12345-0@lo:400:kworker.0 Request processed in 37us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920379.500264:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790920379.500276:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790920379.500282:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972180736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920379.500313:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972180736:12345-0@lo:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920379.500317:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790920379.500644:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920379.500648:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790920379.500679:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33ffb800 x1877915972180480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920379.500691:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972180480:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.500693:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972180096:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790920379.500718:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33ff8e00 x1877915972180736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920379.500726:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972180736:0@lo:400:kworker.0 00000100:00100000:0.0:1790920379.500736:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972180096:12345-0@lo:400:kworker.0 Request processed in 1154us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920379.500742:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790920379.500825:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972180096:0@lo:400:kworker.0 00000001:00100000:3.0:1790920379.554298:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:3.0:1790920379.554310:0:7646:0:(genops.c:885:class_export_put()) final put ffff88eb3a4fc800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:2.0:1790920379.554555:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a4fc800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 for lustre-OST0001 00000020:00000080:2.0:1790920379.555052:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3a4fb800 for lustre-OST0001 00000100:00100000:0.0:1790920380.009176:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972180864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920380.009292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920380.009556:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180864 00000100:00100000:3.0:1790920380.009574:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180864 00000100:00100000:3.0:1790920380.009639:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790920380.009650:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972180864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790920380.009690:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920380.009762:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972180864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920380.009769:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790920380.009903:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41827800 x1877915972180864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920380.009925:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972180864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920380.073892:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920380.073942:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920380.074127:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177600 00000100:00100000:3.0:1790920380.074138:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177600 00000100:00100000:3.0:1790920380.074217:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:3.0:1790920380.074229:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951177600:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920380.074306:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951177600:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 80us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920380.074314:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:1.0:1790920380.074497:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177472 00000100:00100000:1.0:1790920380.074501:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177472 00000100:00100000:1.0:1790920380.074530:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 199 00000100:00100000:1.0:1790920380.074537:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951177472:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920380.074563:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951177472:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 27us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920380.074569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 199 00000100:00080000:0.0:1790920380.075230:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1790920380.080370:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:1.0:1790920380.080382:0:6712:0:(genops.c:885:class_export_put()) final put ffff88eb3a4fe800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:2.0:1790920380.081271:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a4fe800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 for lustre-OST0000 00000020:00000080:2.0:1790920380.081553:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3a4ff800 for lustre-OST0000 00010000:00010000:3.0:1790920380.458419:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920381.481051:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920381.547406:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972180992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920381.547492:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920381.547708:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972180992 00000100:00100000:3.0:1790920381.547719:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972180992 00000100:00100000:3.0:1790920381.547822:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920381.547835:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972180992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920381.547892:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920381.547950:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972180992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920381.547972:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790920381.548169:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34250380 x1877915972180992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920381.548193:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972180992:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790920381.548219:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790920382.505007:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920383.531585:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790920383.897061:0:9254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.63 00010000:00010000:3.0:1790920384.557037:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920384.617180:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972181376:0@lo:400:kworker.0 00000100:00100000:1.0:1790920384.617292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920384.617377:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790920384.617383:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972181248:0@lo:400:kworker.0 00000100:00100000:1.0:1790920384.617406:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920384.617427:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972181760:0@lo:400:kworker.0 00000100:00100000:1.0:1790920384.617453:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920384.617524:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972181376 00000100:00100000:1.0:1790920384.617533:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972181376 00000100:00100000:1.0:1790920384.617595:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972181248 00000100:00100000:1.0:1790920384.617598:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972181248 00000100:00100000:1.0:1790920384.617618:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790920384.617627:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972181376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920384.617685:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972181376:12345-0@lo:400:kworker.0 Request processed in 57us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920384.617691:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790920384.617729:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790920384.617736:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972181248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920384.617777:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972181760 00000100:00100000:3.0:1790920384.617782:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972181760 00000100:00100000:1.0:1790920384.617795:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972181248:12345-0@lo:400:kworker.0 Request processed in 60us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920384.617800:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790920384.617816:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790920384.617823:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972181760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920384.617854:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972181248:0@lo:400:kworker.0 00000100:00100000:1.0:1790920384.617865:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972181376:0@lo:400:kworker.0 00000100:00100000:3.0:1790920384.617908:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972181760:12345-0@lo:400:kworker.0 Request processed in 85us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920384.617915:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1790920384.617931:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33ff9500 x1877915972181760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920384.617943:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972181760:0@lo:400:kworker.0 00000100:00100000:2.0:1790920384.618137:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972181120:0@lo:400:kworker.0 00000100:00100000:2.0:1790920384.618176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920384.618223:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972181632:0@lo:400:kworker.0 00000100:00100000:2.0:1790920384.618247:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920384.618267:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790920384.618274:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972181504:0@lo:400:kworker.0 00000100:00100000:2.0:1790920384.618300:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920384.618341:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972181504 00000100:00100000:2.0:1790920384.618345:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972181504 00000100:00100000:2.0:1790920384.618374:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790920384.618380:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972181504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920384.618416:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972181120 00000100:00100000:2.0:1790920384.618416:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972181504:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920384.618434:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1790920384.618462:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d33800 x1877915972181504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920384.618472:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972181504:0@lo:400:kworker.0 00000100:00100000:2.0:1790920384.618489:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972181632 00000100:00100000:2.0:1790920384.618492:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972181632 00000100:00100000:2.0:1790920384.618515:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790920384.618522:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972181632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920384.618556:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972181632:12345-0@lo:400:kworker.0 Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920384.618561:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790920384.618586:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972181632:0@lo:400:kworker.0 00000100:00080000:0.0:1790920384.618783:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920384.618789:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920384.618793:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920384.618845:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972181120 00000100:00100000:3.0:1790920384.618883:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790920384.618890:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972181120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920384.618929:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972181120:12345-0@lo:400:kworker.0 Request processed in 40us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920384.618935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790920384.623159:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972181120:0@lo:400:kworker.0 00000100:00100000:3.0:1790920385.129789:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920385.129819:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972181888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920385.129913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920385.130043:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972181888 00000100:00100000:2.0:1790920385.130055:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972181888 00000100:00100000:2.0:1790920385.130119:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790920385.130130:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972181888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920385.130176:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920385.130241:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972181888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920385.130247:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790920385.130297:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a28e00 x1877915972181888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920385.130320:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972181888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920385.167021:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920385.167081:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920385.167181:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177728 00000100:00100000:1.0:1790920385.167193:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177728 00000100:00100000:1.0:1790920385.167265:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:1.0:1790920385.167278:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951177728:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920385.167390:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951177728:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 115us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920385.167421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:2.0:1790920385.167575:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177856 00000100:00100000:2.0:1790920385.167581:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177856 00000100:00100000:2.0:1790920385.167651:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:2.0:1790920385.167659:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951177856:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920385.167712:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951177856:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 54us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920385.167718:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00080000:1.0:1790920385.168160:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790920385.577255:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920386.602947:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920386.666474:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920386.666500:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972182016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920386.666583:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920386.666682:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182016 00000100:00100000:3.0:1790920386.666690:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182016 00000100:00100000:3.0:1790920386.666784:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790920386.666796:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972182016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920386.666840:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920386.666891:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972182016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920386.666898:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1790920386.666921:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790920386.666956:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34253b80 x1877915972182016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920386.666975:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972182016:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1790920386.902015:0:9352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.63 00010000:00010000:3.0:1790920387.625145:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920388.649225:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790920389.611223:0:9449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.63 00010000:00010000:0.0:1790920389.673142:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920389.743306:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972182144:0@lo:400:kworker.0 00000100:00100000:3.0:1790920389.743397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920389.746124:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920389.746147:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972182528:0@lo:400:kworker.0 00000100:00100000:3.0:1790920389.746232:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920389.746370:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182528 00000100:00100000:1.0:1790920389.746380:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182528 00000100:00100000:1.0:1790920389.746494:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790920389.746506:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972182528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920389.746588:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972182528:12345-0@lo:400:kworker.0 Request processed in 84us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920389.746596:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1790920389.746656:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a29f80 x1877915972182528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920389.746671:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972182528:0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.746848:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790920389.746858:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972182656:0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.746892:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920389.746936:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972182272:0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.746982:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920389.747002:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972182784:0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.747024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920389.747041:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920389.747048:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972182400:0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.747070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920389.747096:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182656 00000100:00100000:2.0:1790920389.747100:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182656 00000100:00080000:3.0:1790920389.747270:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790920389.747277:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920389.747322:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182144 00000100:00100000:0.0:1790920389.747329:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182144 00000100:00100000:0.0:1790920389.747370:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1790920389.747380:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972182144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.747416:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182272 00000100:00100000:2.0:1790920389.747422:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182272 00000100:00100000:2.0:1790920389.747440:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182400 00000100:00100000:2.0:1790920389.747443:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182400 00000100:00100000:0.0:1790920389.747472:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972182144:12345-0@lo:400:kworker.0 Request processed in 94us (4075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920389.747481:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790920389.747498:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972182144:0@lo:400:kworker.0 00000100:00080000:3.0:1790920389.747547:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920389.747591:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790920389.747613:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972182656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920389.747672:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972182656:12345-0@lo:400:kworker.0 Request processed in 73us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920389.747680:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790920389.747699:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790920389.747702:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972182656:0@lo:400:kworker.0 00000100:00100000:0.0:1790920389.747709:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972182272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920389.747772:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972182272:12345-0@lo:400:kworker.0 Request processed in 65us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920389.747780:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790920389.747790:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972182272:0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.747926:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790920389.747942:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972182400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.747981:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972182400:12345-0@lo:400:kworker.0 Request processed in 40us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920389.747989:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790920389.748012:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182784 00000100:00100000:2.0:1790920389.748015:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182784 00000100:00080000:3.0:1790920389.748113:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920389.748168:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972182400:0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.748267:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790920389.748274:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972182784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920389.748324:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972182784:12345-0@lo:400:kworker.0 Request processed in 51us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920389.748330:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790920389.748711:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a29c00 x1877915972182784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920389.748722:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972182784:0@lo:400:kworker.0 00000100:00100000:3.0:1790920390.250440:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920390.250473:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972182912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920390.250561:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920390.251044:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972182912 00000100:00100000:0.0:1790920390.251056:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972182912 00000100:00100000:0.0:1790920390.251139:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790920390.251150:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972182912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920390.251193:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920390.251270:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972182912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920390.251277:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1790920390.251431:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e3800 x1877915972182912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920390.251454:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972182912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920390.283884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920390.284051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951177984 00000100:00100000:3.0:1790920390.284066:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951177984 00000100:00100000:3.0:1790920390.284148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00100000:3.0:1790920390.284177:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951177984:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920390.284530:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951177984:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 354us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920390.284539:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00100000:0.0:1790920390.286192:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920390.286420:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951178112 00000100:00100000:2.0:1790920390.286431:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951178112 00000100:00100000:2.0:1790920390.286514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1790920390.286525:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951178112:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:3.0:1790920390.286646:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920390.296186:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951178112:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 9641us (9983us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920390.296215:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00010000:00010000:2.0:1790920390.697054:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920391.721923:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920391.786202:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972183040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920391.786303:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920391.786584:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183040 00000100:00100000:3.0:1790920391.786594:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183040 00000100:00100000:3.0:1790920391.786675:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790920391.786687:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972183040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920391.786846:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920391.786904:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972183040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920391.786912:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1790920391.787126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34251880 x1877915972183040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920391.787150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972183040:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790920391.787659:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1790920391.829408:0:9497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Oct 2 01:53:10 EDT 2026 00010000:00010000:2.0:1790920392.745914:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920393.774962:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920394.796695:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920394.872331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972183168:0@lo:400:kworker.0 00000100:00100000:1.0:1790920394.872350:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972183296:0@lo:400:kworker.0 00000100:00100000:0.0:1790920394.872468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920394.872470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920394.872555:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972183808:0@lo:400:kworker.0 00000100:00100000:0.0:1790920394.872561:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972183680:0@lo:400:kworker.0 00000100:00100000:3.0:1790920394.872618:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183168 00000100:00100000:3.0:1790920394.872627:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183168 00000100:00100000:1.0:1790920394.872664:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920394.872678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920394.872684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1790920394.872696:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972183168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920394.872699:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920394.872710:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972183424:0@lo:400:kworker.0 00000100:00100000:0.0:1790920394.872711:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920394.872722:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972183552:0@lo:400:kworker.0 00000100:00100000:1.0:1790920394.872774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920394.878704:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972183168:12345-0@lo:400:kworker.0 Request processed in 6000us (6230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920394.879309:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1790920394.879788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920394.879930:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972183168:0@lo:400:kworker.0 00000100:00100000:0.0:1790920394.879998:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183296 00000100:00100000:0.0:1790920394.880007:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183296 00000100:00100000:0.0:1790920394.880055:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183680 00000100:00100000:0.0:1790920394.880058:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183680 00000100:00100000:1.0:1790920394.880060:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183424 00000100:00100000:1.0:1790920394.880067:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183424 00000100:00100000:0.0:1790920394.880220:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790920394.880231:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972183296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920394.880293:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183808 00000100:00100000:3.0:1790920394.880299:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183808 00000100:00100000:0.0:1790920394.880302:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972183296:12345-0@lo:400:kworker.0 Request processed in 72us (7835us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920394.880333:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183552 00000100:00100000:3.0:1790920394.880336:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183552 00000100:00100000:3.0:1790920394.880368:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790920394.880374:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972183808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920394.880387:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790920394.880406:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790920394.880415:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972183680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920394.880419:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972183808:12345-0@lo:400:kworker.0 Request processed in 43us (7754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920394.880428:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790920394.880445:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790920394.880452:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972183552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920394.880463:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972183680:12345-0@lo:400:kworker.0 Request processed in 48us (7787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920394.880471:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790920394.880490:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972183552:12345-0@lo:400:kworker.0 Request processed in 38us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920394.880497:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1790920394.880815:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920394.880820:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920394.880822:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790920394.880920:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41fb3b80 x1877915972183552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920394.880936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972183552:0@lo:400:kworker.0 00000100:00100000:0.0:1790920394.880963:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972183680:0@lo:400:kworker.0 00000100:00100000:1.0:1790920394.881586:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790920394.881595:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972183424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920394.881648:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972183424:12345-0@lo:400:kworker.0 Request processed in 55us (8873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920394.881654:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790920394.881715:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972183424:0@lo:400:kworker.0 00000100:00100000:1.0:1790920394.881727:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972183296:0@lo:400:kworker.0 00010000:00080000:1.0:1790920394.881740:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41fb1500 x1877915972183808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920394.881765:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972183808:0@lo:400:kworker.0 00000100:00100000:1.0:1790920395.369098:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972183936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920395.369382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920395.370835:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972183936 00000100:00100000:2.0:1790920395.370852:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972183936 00000100:00100000:2.0:1790920395.370924:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790920395.370934:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972183936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920395.370982:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920395.375081:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972183936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4125us (5676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920395.375098:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790920395.375973:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34251f80 x1877915972183936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920395.376021:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972183936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920395.404064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920395.404173:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920395.404687:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951178368 00000100:00100000:1.0:1790920395.404701:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951178368 00000100:00100000:1.0:1790920395.404818:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:1.0:1790920395.404840:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951178368:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920395.404926:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951178368:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 99us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920395.404934:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00080000:0.0:1790920395.407617:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920395.408843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951178240 00000100:00100000:3.0:1790920395.408861:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951178240 00000100:00100000:3.0:1790920395.408936:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 205 00000100:00100000:3.0:1790920395.408947:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951178240:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920395.409044:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951178240:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 98us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920395.409051:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 205 00010000:00010000:3.0:1790920395.817140:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920396.841073:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920396.913028:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972184064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920396.913114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920396.914699:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184064 00000100:00100000:0.0:1790920396.914722:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184064 00000100:00100000:0.0:1790920396.914854:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790920396.914865:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972184064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790920396.915029:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920396.915110:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972184064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920396.915117:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790920396.919104:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34252d80 x1877915972184064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920396.919135:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972184064:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790920396.926648:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790920397.881186:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920398.893554:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920399.914534:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920399.980652:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972184448:0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.980707:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972184192:0@lo:400:kworker.0 00000100:00100000:1.0:1790920399.980797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920399.980800:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920399.980854:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972184576:0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.996595:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972184704:0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.996695:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920399.996781:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972184320:0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.996820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920399.996841:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972184832:0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.996900:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920399.996961:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184448 00000100:00100000:0.0:1790920399.996969:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184448 00000100:00100000:0.0:1790920399.997063:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184704 00000100:00100000:0.0:1790920399.997107:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184704 00000100:00100000:0.0:1790920399.997127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184320 00000100:00100000:0.0:1790920399.997163:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184320 00000100:00100000:0.0:1790920399.997211:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790920399.997249:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972184448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.997316:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972184448:12345-0@lo:400:kworker.0 Request processed in 83us (16518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920399.997323:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790920399.997339:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790920399.997344:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972184704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.997370:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972184704:12345-0@lo:400:kworker.0 Request processed in 26us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920399.997375:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790920399.997384:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790920399.997389:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972184320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.997427:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972184320:12345-0@lo:400:kworker.0 Request processed in 38us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920399.997432:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790920399.997452:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184192 00000100:00100000:0.0:1790920399.997455:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184192 00000100:00100000:0.0:1790920399.997480:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790920399.997486:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972184192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.997518:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972184192:12345-0@lo:400:kworker.0 Request processed in 32us (16716us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920399.997524:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790920399.997554:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184832 00000100:00100000:0.0:1790920399.997557:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184832 00000100:00100000:0.0:1790920399.997589:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790920399.997594:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972184832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.997621:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972184832:12345-0@lo:400:kworker.0 Request processed in 27us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920399.997626:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790920399.997639:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920399.997642:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920399.997670:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972184320:0@lo:400:kworker.0 00010000:00080000:0.0:1790920399.997682:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d33800 x1877915972184832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920399.997692:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972184832:0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.997721:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972184192:0@lo:400:kworker.0 00000100:00100000:0.0:1790920399.997731:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972184704:0@lo:400:kworker.0 00000100:00100000:3.0:1790920400.005373:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920400.006293:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184576 00000100:00100000:0.0:1790920400.006306:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184576 00000100:00100000:0.0:1790920400.006369:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790920400.006381:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972184576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920400.006480:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972184576:12345-0@lo:400:kworker.0 Request processed in 102us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920400.006488:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1790920400.006511:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790920400.006543:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d33b80 x1877915972184576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920400.006557:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972184576:0@lo:400:kworker.0 00000100:00100000:1.0:1790920400.012849:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972184448:0@lo:400:kworker.0 00000100:00100000:0.0:1790920400.489491:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920400.489560:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972184960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920400.490291:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920400.490380:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972184960 00000100:00100000:0.0:1790920400.490401:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972184960 00000100:00100000:0.0:1790920400.492034:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790920400.492049:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972184960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920400.492092:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920400.493570:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972184960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1518us (3275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920400.493582:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790920400.497137:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d31c00 x1877915972184960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920400.497168:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972184960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920400.534710:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920400.534854:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951178496 00000100:00100000:3.0:1790920400.534864:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951178496 00000100:00100000:3.0:1790920400.534922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 207 00000100:00100000:3.0:1790920400.534933:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951178496:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920400.535028:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951178496:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920400.535037:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 207 00000100:00100000:1.0:1790920400.535544:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920400.535628:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951178624 00000100:00100000:2.0:1790920400.535634:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951178624 00000100:00100000:2.0:1790920400.535688:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:2.0:1790920400.535697:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951178624:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920400.535743:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951178624:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 48us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920400.535769:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00080000:1.0:1790920400.536166:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790920400.948846:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920401.966499:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920402.025003:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972185088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920402.025074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920402.025130:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185088 00000100:00100000:1.0:1790920402.025140:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185088 00000100:00100000:1.0:1790920402.025220:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790920402.025231:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972185088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920402.025269:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920402.025323:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972185088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920402.025330:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1790920402.025380:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e3800 x1877915972185088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920402.025426:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972185088:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790920402.025557:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790920402.986178:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920404.009576:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920405.033022:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920405.100039:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972185216:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100130:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920405.100177:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972185728:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920405.100232:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920405.100238:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972185600:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100283:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920405.100330:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972185344:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920405.100373:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972185856:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100393:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920405.100412:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920405.100417:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972185472:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100438:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920405.100475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185216 00000100:00100000:3.0:1790920405.100483:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185216 00000100:00100000:3.0:1790920405.100528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790920405.100537:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972185216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100594:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972185216:12345-0@lo:400:kworker.0 Request processed in 57us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920405.100609:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790920405.100644:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185728 00000100:00100000:3.0:1790920405.100648:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185728 00000100:00100000:3.0:1790920405.100675:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185344 00000100:00100000:3.0:1790920405.100679:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185344 00000100:00100000:3.0:1790920405.100690:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185472 00000100:00100000:3.0:1790920405.100693:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185472 00000100:00100000:3.0:1790920405.100709:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790920405.100715:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972185728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100774:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972185728:12345-0@lo:400:kworker.0 Request processed in 59us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920405.100781:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790920405.100793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790920405.100799:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972185344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100831:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972185344:12345-0@lo:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920405.100838:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790920405.100850:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790920405.100856:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972185472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100880:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972185472:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920405.100885:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790920405.100903:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185600 00000100:00100000:3.0:1790920405.100906:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185600 00000100:00100000:3.0:1790920405.100929:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185856 00000100:00100000:3.0:1790920405.100931:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185856 00000100:00100000:3.0:1790920405.100953:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790920405.100966:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972185600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.100997:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972185600:12345-0@lo:400:kworker.0 Request processed in 32us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920405.101002:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790920405.101014:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790920405.101020:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972185856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.101046:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972185856:12345-0@lo:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920405.101051:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790920405.101102:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972185472:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.101114:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972185344:0@lo:400:kworker.0 00010000:00080000:3.0:1790920405.101125:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34251f80 x1877915972185856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920405.101136:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972185856:0@lo:400:kworker.0 00010000:00080000:3.0:1790920405.101381:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34253480 x1877915972185600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920405.101389:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972185600:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.101398:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972185216:0@lo:400:kworker.0 00000100:00100000:3.0:1790920405.101407:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972185728:0@lo:400:kworker.0 00000100:00080000:0.0:1790920405.103608:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920405.103621:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920405.103625:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920405.620546:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920405.620571:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972185984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920405.620645:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920405.620980:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972185984 00000100:00100000:0.0:1790920405.620989:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972185984 00000100:00100000:1.0:1790920405.624615:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790920405.624655:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972185984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790920405.624698:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920405.627520:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972185984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2882us (6865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920405.627534:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1790920405.627635:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f525500 x1877915972185984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920405.627659:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972185984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920405.646419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920405.646469:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920405.646501:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951178880 00000100:00100000:1.0:1790920405.646510:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951178880 00000100:00100000:1.0:1790920405.646569:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:1.0:1790920405.646578:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951178880:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920405.646661:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951178880:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920405.646669:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00080000:1.0:1790920405.646689:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920405.646854:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951178752 00000100:00100000:0.0:1790920405.646859:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951178752 00000100:00100000:0.0:1790920405.646902:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 209 00000100:00100000:0.0:1790920405.646910:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951178752:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920405.646946:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2352:x1877915951178752:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 37us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920405.646970:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 209 00010000:00010000:2.0:1790920406.060262:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920407.081650:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920407.145474:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920407.145501:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972186112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920407.145577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920407.145632:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972186112 00000100:00100000:2.0:1790920407.145640:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972186112 00000100:00080000:1.0:1790920407.145698:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790920407.145700:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790920407.145709:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972186112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920407.145790:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920407.145846:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972186112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920407.145853:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790920407.145978:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e1c00 x1877915972186112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920407.145998:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972186112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790920408.104935:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920409.130123:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790920409.526923:0:10128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:53:27 (1790920407) === 00010000:00010000:2.0:1790920410.157195:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920410.218655:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972186496:0@lo:400:kworker.0 00000100:00100000:2.0:1790920410.218738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920410.218852:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790920410.218859:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972186368:0@lo:400:kworker.0 00000100:00100000:2.0:1790920410.218884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920410.218902:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972186880:0@lo:400:kworker.0 00000100:00100000:2.0:1790920410.218929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920410.219112:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972186624:0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920410.219171:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790920410.219177:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972186240:0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219219:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920410.219243:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972186752:0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920410.219293:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972186496 00000100:00100000:3.0:1790920410.219301:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972186496 00000100:00100000:3.0:1790920410.219363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972186368 00000100:00100000:3.0:1790920410.219366:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972186368 00000100:00100000:3.0:1790920410.219377:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972186752 00000100:00100000:3.0:1790920410.219379:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972186752 00000100:00100000:3.0:1790920410.219395:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790920410.219403:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972186496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219462:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972186496:12345-0@lo:400:kworker.0 Request processed in 59us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.219469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790920410.219486:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920410.219493:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972186368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219520:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972186368:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.219544:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920410.219556:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790920410.219562:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972186752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219596:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972186752:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.219602:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790920410.219620:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972186880 00000100:00100000:3.0:1790920410.219623:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972186880 00000100:00100000:3.0:1790920410.219649:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972186624 00000100:00100000:3.0:1790920410.219652:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972186624 00000100:00100000:3.0:1790920410.219669:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790920410.219675:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972186880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219705:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972186880:12345-0@lo:400:kworker.0 Request processed in 30us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.219711:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790920410.219722:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790920410.219727:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972186624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219794:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972186624:12345-0@lo:400:kworker.0 Request processed in 66us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.219799:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790920410.219817:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972186240 00000100:00100000:3.0:1790920410.219820:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972186240 00000100:00100000:3.0:1790920410.219842:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790920410.219848:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972186240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219877:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972186240:12345-0@lo:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.219895:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790920410.219941:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972186240:0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.219954:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972186752:0@lo:400:kworker.0 00010000:00080000:3.0:1790920410.219965:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e0a80 x1877915972186624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920410.219975:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972186624:0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.220012:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972186368:0@lo:400:kworker.0 00010000:00080000:3.0:1790920410.220021:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e2a00 x1877915972186880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920410.220029:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972186880:0@lo:400:kworker.0 00000100:00100000:3.0:1790920410.220038:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972186496:0@lo:400:kworker.0 00000100:00080000:1.0:1790920410.220990:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790920410.220998:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920410.221002:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920410.584478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920410.584663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179008 00000100:00100000:1.0:1790920410.584675:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179008 00000100:00100000:1.0:1790920410.584784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:1.0:1790920410.584796:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:8130:x1877915951179008:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790920410.584844:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920410.584866:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029eea00/0x2a4915844546a171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46eda9e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920410.584900:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029eea00/0x2a4915844546a171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9e4 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920410.584913:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029eea00/0x2a4915844546a171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9e4 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920410.584923:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029eea00, rc 0) 00000100:00100000:1.0:1790920410.585001:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8130:x1877915951179008:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 207us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920410.585008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:3.0:1790920410.601470:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920410.602058:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179136 00000100:00100000:0.0:1790920410.602070:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179136 00000100:00100000:0.0:1790920410.602136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:0.0:1790920410.602147:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8130:x1877915951179136:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790920410.602572:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8130:x1877915951179136:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 425us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920410.602581:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:2.0:1790920410.624117:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920410.624270:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179264 00000100:00100000:3.0:1790920410.624283:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179264 00000100:00100000:3.0:1790920410.624419:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 213 00000100:00100000:3.0:1790920410.624430:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8130:x1877915951179264:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790920410.624870:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8130:x1877915951179264:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 440us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.624880:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 213 00000100:00100000:2.0:1790920410.648893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920410.648997:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179392 00000100:00100000:1.0:1790920410.649014:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179392 00000100:00100000:3.0:1790920410.649191:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 214 00000100:00100000:3.0:1790920410.649328:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8134:x1877915951179392:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790920410.649718:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8134:x1877915951179392:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 395us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.649726:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 214 00000100:00100000:0.0:1790920410.692686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920410.692813:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179520 00000100:00100000:2.0:1790920410.692823:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179520 00000100:00100000:2.0:1790920410.692887:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00100000:2.0:1790920410.692895:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8134:x1877915951179520:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790920410.693191:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8134:x1877915951179520:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 295us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920410.693219:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00100000:2.0:1790920410.701122:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920410.701489:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179648 00000100:00100000:3.0:1790920410.701502:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179648 00000100:00100000:3.0:1790920410.701564:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:3.0:1790920410.701583:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:8130:x1877915951179648:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790920410.701602:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920410.701620:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e37000/0x2a4915844546a178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa0e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920410.701648:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e37000/0x2a4915844546a178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa0e expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920410.701660:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e37000/0x2a4915844546a178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa0e expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920410.701669:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37000, rc 0) 00000100:00100000:3.0:1790920410.701729:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:8130:x1877915951179648:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 157us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.701737:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:0.0:1790920410.720049:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920410.721450:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179776 00000100:00100000:3.0:1790920410.721464:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179776 00000100:00100000:3.0:1790920410.721533:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 217 00000100:00100000:3.0:1790920410.721546:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:8130:x1877915951179776:12345-192.168.204.34@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790920410.721575:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790920410.721614:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790920410.721617:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790920410.721620:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790920410.721622:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790920410.725894:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:8130:x1877915951179776:12345-192.168.204.34@tcp:256:mount.lustre.0 Request processed in 4339us (5846us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.725908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 217 00000100:00100000:1.0:1790920410.728823:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920410.730706:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951179904 00000100:00100000:3.0:1790920410.730722:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951179904 00000100:00100000:3.0:1790920410.730814:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00100000:3.0:1790920410.730824:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:8130:x1877915951179904:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790920410.730840:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920410.730860:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa15 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920410.730886:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920410.730897:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920410.730905:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36000, rc 0) 00000100:00100000:3.0:1790920410.730966:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8130:x1877915951179904:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 143us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.730973:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00100000:0.0:1790920410.731555:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920410.731574:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972187008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920410.731628:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920410.731925:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187008 00000100:00100000:2.0:1790920410.731932:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187008 00000100:00100000:2.0:1790920410.731979:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790920410.731986:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972187008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920410.732020:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920410.732074:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972187008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920410.732081:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1790920410.732269:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e1f80 x1877915972187008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920410.732290:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972187008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920410.733705:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920410.733854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180032 00000100:00100000:3.0:1790920410.733862:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180032 00000100:00100000:3.0:1790920410.733919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 219 00000100:00100000:3.0:1790920410.733927:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8130:x1877915951180032:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790920410.734241:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8130:x1877915951180032:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 313us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.734250:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 219 00000100:00100000:3.0:1790920410.740983:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920410.741171:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180160 00000100:00100000:0.0:1790920410.741184:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180160 00000100:00100000:0.0:1790920410.741272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 220 00000100:00100000:0.0:1790920410.741284:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8130:x1877915951180160:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790920410.741559:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8130:x1877915951180160:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 277us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920410.741567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 220 00000100:00100000:1.0:1790920410.758588:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920410.759334:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180288 00000100:00100000:0.0:1790920410.759347:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180288 00000100:00100000:0.0:1790920410.759409:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 221 00000100:00100000:0.0:1790920410.759420:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8138:x1877915951180288:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790920410.759687:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8138:x1877915951180288:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 267us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920410.759696:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 221 00000100:00100000:2.0:1790920410.762373:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920410.762543:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180416 00000100:00100000:3.0:1790920410.762553:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180416 00000100:00100000:3.0:1790920410.762613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 222 00000100:00100000:3.0:1790920410.762623:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8138:x1877915951180416:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790920410.769411:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:8138:x1877915951180416:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 6775us (7032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.769428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 222 00000100:00100000:1.0:1790920410.769530:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920410.769954:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180544 00000100:00100000:3.0:1790920410.769967:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180544 00000100:00100000:3.0:1790920410.770294:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:3.0:1790920410.770307:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951180544:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920410.770399:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951180544:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 95us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.770408:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00080000:0.0:1790920410.770664:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920410.780522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920410.780635:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180672 00000100:00100000:2.0:1790920410.780647:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180672 00000100:00100000:2.0:1790920410.780698:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:2.0:1790920410.780707:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1877915951180672:12345-192.168.204.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790920410.780792:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2b056702-0296-4eba-8ec3-f47ff1a30c26@192.168.204.34@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:2.0:1790920410.780844:0:5846:0:(genops.c:1384:class_connect()) connect: client 2b056702-0296-4eba-8ec3-f47ff1a30c26, cookie 0x2a4915844546a186 00000004:00100000:2.0:1790920410.780877:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790920410.781166:0:5846:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4eb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790920410.781254:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2351:x1877915951180672:12345-192.168.204.34@tcp:38:mount.lustre.0 Request processed in 546us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920410.781262:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:2.0:1790920410.787713:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920410.787952:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920410.793949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180800 00000100:00100000:1.0:1790920410.793975:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180800 00000100:00100000:0.0:1790920410.794230:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951180928 00000100:00100000:0.0:1790920410.794235:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951180928 00000100:00100000:0.0:1790920410.794260:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1790920410.794271:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+7:0:x1877915951180800:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790920410.794331:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790920410.794458:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+7:0:x1877915951180800:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 187us (6764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920410.794466:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1790920410.794489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920410.794496:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:8130:x1877915951180928:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790920410.794508:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790920410.794532:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:8130:x1877915951180928:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 37us (6581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920410.794561:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00080000:1.0:1790920410.794676:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920410.797533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920410.797647:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181056 00000100:00100000:0.0:1790920410.797661:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181056 00000100:00100000:0.0:1790920410.797737:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1790920410.797959:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:8130:x1877915951181056:12345-192.168.204.34@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790920410.798089:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:8130:x1877915951181056:12345-192.168.204.34@tcp:40:mount.lustre.0 Request processed in 340us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920410.798097:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1790920410.801363:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920410.801479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920410.801558:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920410.801625:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181440 00000100:00100000:2.0:1790920410.801645:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181440 00000100:00100000:2.0:1790920410.801727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:2.0:1790920410.801740:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:8130:x1877915951181440:12345-192.168.204.34@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790920410.801900:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790920410.802015:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:8130:x1877915951181440:12345-192.168.204.34@tcp:33:mount.lustre.0 Request processed in 277us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920410.802025:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:3.0:1790920410.804079:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181184 00000100:00100000:3.0:1790920410.804100:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181184 00000100:00100000:3.0:1790920410.804156:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181312 00000100:00100000:3.0:1790920410.804161:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181312 00000100:00100000:3.0:1790920410.804204:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:3.0:1790920410.804215:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1877915951181184:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790920410.804265:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2b056702-0296-4eba-8ec3-f47ff1a30c26@192.168.204.34@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:3.0:1790920410.804321:0:6689:0:(genops.c:1384:class_connect()) connect: client 2b056702-0296-4eba-8ec3-f47ff1a30c26, cookie 0x2a4915844546a18d 00002000:00100000:3.0:1790920410.804337:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2b056702-0296-4eba-8ec3-f47ff1a30c26/ffff88eb34411000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790920410.804351:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790920410.804645:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790920410.804685:0:6689:0:(import.c:65:import_set_state_nolock()) ffff88eb34410000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790920410.804791:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2351:x1877915951181184:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 576us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920410.804799:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920410.804906:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1790920410.804914:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1877915951181312:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790920410.804934:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2b056702-0296-4eba-8ec3-f47ff1a30c26@192.168.204.34@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1790920410.804958:0:6688:0:(genops.c:1384:class_connect()) connect: client 2b056702-0296-4eba-8ec3-f47ff1a30c26, cookie 0x2a4915844546a194 00002000:00100000:0.0:1790920410.804964:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b056702-0296-4eba-8ec3-f47ff1a30c26/ffff88eb07062000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790920410.804984:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790920410.805131:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790920410.805147:0:6688:0:(import.c:65:import_set_state_nolock()) ffff88eb07063800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920410.805174:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2351:x1877915951181312:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 260us (3617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920410.805180:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00010000:00010000:3.0:1790920411.179913:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920412.205617:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920412.268080:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920412.268127:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972187136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920412.268246:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920412.268562:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187136 00000100:00100000:2.0:1790920412.268572:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187136 00000100:00100000:2.0:1790920412.268670:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790920412.268684:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972187136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920412.268731:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920412.268821:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972187136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920412.268828:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1790920412.271706:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790920412.271826:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e2d80 x1877915972187136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920412.271896:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972187136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790920413.225158:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920414.249957:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790920414.923875:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b056702-0296-4eba-8ec3-f47ff1a30c26 00010000:00010000:3.0:1790920415.275169:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920415.340557:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972187264:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.341062:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920415.341252:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972187776:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.341289:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920415.341471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187264 00000100:00100000:0.0:1790920415.341479:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187264 00000100:00100000:0.0:1790920415.341535:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790920415.341544:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972187264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920415.341596:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972187264:12345-0@lo:400:kworker.0 Request processed in 52us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920415.341602:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790920415.341829:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972187264:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.341846:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790920415.341853:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972187648:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.341881:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920415.341921:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972187392:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.341945:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920415.341967:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972187904:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.341989:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920415.342009:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920415.342016:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972187520:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.342038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920415.342068:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187776 00000100:00100000:1.0:1790920415.342072:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187776 00000100:00100000:1.0:1790920415.342121:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187392 00000100:00100000:1.0:1790920415.342125:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187392 00000100:00100000:1.0:1790920415.342137:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187520 00000100:00100000:1.0:1790920415.342139:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187520 00000100:00100000:1.0:1790920415.342152:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790920415.342158:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972187776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.342200:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972187776:12345-0@lo:400:kworker.0 Request processed in 41us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.342223:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790920415.342239:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790920415.342245:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972187392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.342280:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972187392:12345-0@lo:400:kworker.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.342285:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790920415.342297:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790920415.342303:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972187520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920415.342470:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187648 00000100:00100000:0.0:1790920415.342474:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187648 00000100:00100000:0.0:1790920415.342506:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972187904 00000100:00100000:0.0:1790920415.342509:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972187904 00000100:00100000:0.0:1790920415.342531:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790920415.342537:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972187648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920415.342575:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972187648:12345-0@lo:400:kworker.0 Request processed in 38us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920415.342581:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790920415.342592:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790920415.342598:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972187904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920415.342624:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972187904:12345-0@lo:400:kworker.0 Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920415.342629:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790920415.342985:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972187520:12345-0@lo:400:kworker.0 Request processed in 682us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.342992:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1790920415.343017:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920415.343021:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790920415.343024:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790920415.343050:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c70a80 x1877915972187648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920415.343064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972187648:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.343076:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972187776:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.343115:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972187520:0@lo:400:kworker.0 00000100:00100000:1.0:1790920415.343126:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972187392:0@lo:400:kworker.0 00010000:00080000:1.0:1790920415.343135:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c72a00 x1877915972187904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920415.343144:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972187904:0@lo:400:kworker.0 00000001:00100000:2.0:1790920415.424709:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b056702-0296-4eba-8ec3-f47ff1a30c26 00000100:00100000:1.0:1790920415.849182:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972188032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920415.849260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920415.849459:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188032 00000100:00100000:0.0:1790920415.849469:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188032 00000100:00100000:0.0:1790920415.849518:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790920415.849528:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972188032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920415.849580:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920415.849635:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972188032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920415.849643:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790920415.849686:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e2d80 x1877915972188032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920415.849706:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972188032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920415.892392:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920415.892446:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920415.892474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920415.892493:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920415.892517:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920415.892545:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181568 00000100:00100000:1.0:1790920415.892554:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181568 00000100:00100000:1.0:1790920415.892610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 224 00000100:00100000:1.0:1790920415.892620:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951181568:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920415.892701:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951181568:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.892708:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 224 00000100:00100000:1.0:1790920415.892739:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181824 00000100:00100000:1.0:1790920415.892767:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181824 00000100:00100000:1.0:1790920415.892803:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181696 00000100:00100000:1.0:1790920415.892806:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181696 00000100:00100000:1.0:1790920415.892824:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:1.0:1790920415.892848:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951181824:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920415.892878:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951181824:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 32us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.892884:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:1.0:1790920415.892897:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:1.0:1790920415.892909:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951181696:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920415.892955:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951181696:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 52us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.892962:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:1.0:1790920415.892981:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182080 00000100:00100000:1.0:1790920415.892984:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182080 00000100:00100000:1.0:1790920415.893011:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951181952 00000100:00100000:1.0:1790920415.893014:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951181952 00000100:00100000:1.0:1790920415.893033:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:1.0:1790920415.893038:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951182080:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920415.893064:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951182080:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.893071:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:1.0:1790920415.893083:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:1.0:1790920415.893089:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2352:x1877915951181952:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920415.893127:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2352:x1877915951181952:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 39us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920415.893133:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00080000:0.0:1790920415.894074:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920415.894082:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920415.894086:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1790920415.992619:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b056702-0296-4eba-8ec3-f47ff1a30c26 00010000:00010000:3.0:1790920416.298253:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920417.322285:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920417.390491:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972188160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920417.390562:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920417.391119:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188160 00000100:00100000:2.0:1790920417.391129:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188160 00000100:00100000:3.0:1790920417.391308:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790920417.391321:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972188160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920417.391370:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920417.391449:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972188160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920417.391457:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1790920417.391596:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41fb0700 x1877915972188160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920417.391629:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972188160:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790920417.393840:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1790920418.168616:0:10325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1790920418.357252:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920419.370953:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920420.393210:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920420.457094:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972188544:0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.457173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920420.457237:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790920420.457244:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972188416:0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.457267:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920420.457286:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972188928:0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.457313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920420.457349:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188544 00000100:00100000:0.0:1790920420.457356:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188544 00000100:00100000:0.0:1790920420.457421:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188416 00000100:00100000:0.0:1790920420.457425:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188416 00000100:00100000:0.0:1790920420.457449:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790920420.457458:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972188544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920420.457718:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972188288:0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.457792:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972188544:12345-0@lo:400:kworker.0 Request processed in 334us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920420.457809:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790920420.457828:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790920420.457835:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972188416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920420.457899:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972188672:0@lo:400:kworker.0 00000100:00100000:3.0:1790920420.467910:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920420.467973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188288 00000100:00100000:3.0:1790920420.467983:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188288 00000100:00100000:3.0:1790920420.468047:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790920420.468071:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972188288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920420.468125:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972188288:12345-0@lo:400:kworker.0 Request processed in 56us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920420.468132:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790920420.468198:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972188288:0@lo:400:kworker.0 00000100:00100000:3.0:1790920420.468210:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972188800:0@lo:400:kworker.0 00000100:00100000:3.0:1790920420.468241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920420.471924:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972188544:0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.472244:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972188416:12345-0@lo:400:kworker.0 Request processed in 14407us (14972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920420.472257:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790920420.472287:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188800 00000100:00100000:0.0:1790920420.472295:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188800 00000100:00100000:0.0:1790920420.472332:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790920420.472341:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972188800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.472408:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972188800:12345-0@lo:400:kworker.0 Request processed in 68us (4166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920420.472416:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790920420.472446:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972188800:0@lo:400:kworker.0 00000100:00100000:3.0:1790920420.473852:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972188416:0@lo:400:kworker.0 00000100:00100000:1.0:1790920420.473997:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920420.477169:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188928 00000100:00100000:0.0:1790920420.477182:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188928 00000100:00100000:0.0:1790920420.477247:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972188672 00000100:00100000:0.0:1790920420.477252:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972188672 00000100:00100000:0.0:1790920420.477284:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790920420.477296:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972188928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.477402:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972188928:12345-0@lo:400:kworker.0 Request processed in 108us (20087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920420.477409:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1790920420.477467:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920420.477472:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920420.477474:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920420.477489:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790920420.477498:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972188672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920420.477537:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972188672:12345-0@lo:400:kworker.0 Request processed in 41us (3541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920420.477552:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1790920420.477740:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c60a80 x1877915972188928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920420.477771:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972188928:0@lo:400:kworker.0 00010000:00080000:0.0:1790920420.477945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a28700 x1877915972188672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920420.477955:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972188672:0@lo:400:kworker.0 00000100:00100000:0.0:1790920420.970575:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972189056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920420.970649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920420.970720:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189056 00000100:00100000:0.0:1790920420.970728:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189056 00000100:00100000:0.0:1790920420.970799:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790920420.970809:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972189056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920420.970842:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920420.970893:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972189056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920420.970899:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1790920420.971078:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f525180 x1877915972189056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920420.971098:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972189056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920421.010962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920421.011017:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920421.011056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182464 00000100:00100000:3.0:1790920421.011061:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920421.011067:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182464 00000100:00100000:3.0:1790920421.011082:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920421.011104:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920421.011122:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182336 00000100:00100000:3.0:1790920421.011123:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182720 00000100:00100000:2.0:1790920421.011125:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182336 00000100:00100000:3.0:1790920421.011126:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182720 00000100:00100000:2.0:1790920421.011145:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:2.0:1790920421.011154:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951182464:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920421.011227:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951182464:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920421.011234:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:2.0:1790920421.011250:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:2.0:1790920421.011257:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951182336:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920421.011281:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951182336:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920421.011287:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:2.0:1790920421.011305:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182592 00000100:00100000:2.0:1790920421.011309:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182592 00000100:00100000:2.0:1790920421.011350:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:3.0:1790920421.011355:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:2.0:1790920421.011356:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951182592:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920421.011361:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951182720:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920421.011389:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951182720:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920421.011389:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951182592:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920421.011396:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:2.0:1790920421.011408:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00080000:2.0:1790920421.011420:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920421.011423:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920421.011425:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920421.014712:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182208 00000100:00100000:1.0:1790920421.014727:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182208 00000100:00100000:1.0:1790920421.014873:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 226 00000100:00100000:1.0:1790920421.014883:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2354:x1877915951182208:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920421.014955:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2354:x1877915951182208:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 72us (4002us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920421.014963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 226 00010000:00010000:0.0:1790920421.418056:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920422.445797:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920422.505050:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972189184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790920422.505122:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920422.505293:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189184 00000100:00100000:1.0:1790920422.505303:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189184 00000100:00100000:1.0:1790920422.505364:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790920422.505373:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972189184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920422.505407:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920422.505456:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972189184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920422.505463:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1790920422.505646:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790920422.505677:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c72d80 x1877915972189184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920422.505694:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972189184:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790920423.468085:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920424.489193:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920425.517091:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920425.584990:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972189312:0@lo:400:kworker.0 00000100:00100000:1.0:1790920425.585108:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920425.594715:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972189568:0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.594828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920425.594873:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790920425.594880:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972189440:0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.594903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920425.594953:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972189696:0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.594996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920425.595036:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189568 00000100:00100000:2.0:1790920425.595046:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189568 00000100:00100000:2.0:1790920425.595113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189440 00000100:00100000:2.0:1790920425.595116:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189440 00000100:00100000:2.0:1790920425.595135:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790920425.595145:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972189568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.595213:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972189568:12345-0@lo:400:kworker.0 Request processed in 68us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920425.595235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790920425.595256:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790920425.595262:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972189440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.595291:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972189440:12345-0@lo:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920425.595296:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790920425.595317:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189696 00000100:00100000:2.0:1790920425.595321:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189696 00000100:00100000:2.0:1790920425.595350:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790920425.595357:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972189696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.595389:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972189696:12345-0@lo:400:kworker.0 Request processed in 33us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920425.595395:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1790920425.595410:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920425.595416:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920425.595631:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189312 00000100:00100000:1.0:1790920425.595637:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189312 00000100:00100000:1.0:1790920425.595667:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1790920425.595673:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972189312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920425.595718:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972189312:12345-0@lo:400:kworker.0 Request processed in 45us (10611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920425.595724:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1790920425.595918:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972189312:0@lo:400:kworker.0 00010000:00080000:2.0:1790920425.597148:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c62680 x1877915972189696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920425.597169:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972189696:0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.597225:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972189440:0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.597237:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972189568:0@lo:400:kworker.0 00000100:00100000:0.0:1790920425.598822:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972189824:0@lo:400:kworker.0 00000100:00100000:0.0:1790920425.598922:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920425.602652:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189824 00000100:00100000:2.0:1790920425.602670:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189824 00000100:00100000:2.0:1790920425.603576:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790920425.603594:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972189824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920425.603765:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972189824:12345-0@lo:400:kworker.0 Request processed in 178us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920425.603773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1790920425.603813:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920425.606547:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972189824:0@lo:400:kworker.0 00000100:00100000:0.0:1790920425.606663:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790920425.606678:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972189952:0@lo:400:kworker.0 00000100:00100000:0.0:1790920425.606785:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920425.606844:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972189952 00000100:00100000:0.0:1790920425.606854:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972189952 00000100:00100000:0.0:1790920425.606935:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790920425.606946:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972189952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920425.607017:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972189952:12345-0@lo:400:kworker.0 Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920425.607025:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1790920425.607057:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790920425.607079:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c60e00 x1877915972189952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920425.607109:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972189952:0@lo:400:kworker.0 00000100:00100000:2.0:1790920426.089665:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920426.089696:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972190080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920426.089819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920426.090280:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190080 00000100:00100000:3.0:1790920426.090291:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190080 00000100:00100000:3.0:1790920426.090374:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790920426.090386:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972190080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790920426.090429:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920426.090485:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972190080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920426.090493:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1790920426.092823:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f526300 x1877915972190080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920426.092861:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972190080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920426.126174:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920426.126224:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920426.126254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920426.126284:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920426.126341:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920426.126378:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951183360 00000100:00100000:1.0:1790920426.126389:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951183360 00000100:00100000:1.0:1790920426.126458:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951183232 00000100:00100000:1.0:1790920426.126461:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951183232 00000100:00100000:1.0:1790920426.126489:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:1.0:1790920426.126500:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951183360:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920426.126595:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951183360:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920426.126604:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:1.0:1790920426.126624:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1790920426.126630:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951183232:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920426.126658:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951183232:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920426.126664:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1790920426.126682:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951183104 00000100:00100000:1.0:1790920426.126686:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951183104 00000100:00100000:1.0:1790920426.126713:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182976 00000100:00100000:1.0:1790920426.126716:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182976 00000100:00100000:1.0:1790920426.126730:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:1.0:1790920426.126735:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951183104:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920426.126797:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951183104:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 61us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920426.126813:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:1.0:1790920426.126826:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:1.0:1790920426.126832:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951182976:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920426.126856:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951182976:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920426.126863:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00080000:1.0:1790920426.126883:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790920426.126889:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790920426.126891:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790920426.127306:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951182848 00000100:00100000:0.0:1790920426.127312:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951182848 00000100:00100000:0.0:1790920426.127362:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 228 00000100:00100000:0.0:1790920426.127371:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951182848:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920426.127408:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951182848:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 39us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920426.127415:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 228 00010000:00010000:0.0:1790920426.537115:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920427.561678:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920427.626380:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790920427.626403:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972190208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790920427.626472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920427.626610:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190208 00000100:00100000:1.0:1790920427.626619:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190208 00000100:00100000:1.0:1790920427.626692:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790920427.626702:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972190208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920427.626740:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920427.626819:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972190208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920427.626826:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1790920427.627075:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790920427.627107:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c71c00 x1877915972190208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920427.627126:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972190208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790920428.585083:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920429.609196:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920430.633966:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920430.698235:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972190336:0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.698308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920430.698371:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972190848:0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.698399:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920430.698439:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920430.698446:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972190720:0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.698472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920430.698501:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972190464:0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.698523:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920430.698542:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972190976:0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.698572:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920430.698591:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920430.698596:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972190592:0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.698637:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920430.698669:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190720 00000100:00100000:0.0:1790920430.698677:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190720 00000100:00100000:0.0:1790920430.698743:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190976 00000100:00100000:0.0:1790920430.698767:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190976 00000100:00100000:0.0:1790920430.698804:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790920430.698823:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972190720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.700160:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972190720:12345-0@lo:400:kworker.0 Request processed in 1332us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920430.700173:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790920430.700201:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790920430.700211:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972190976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.700248:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972190976:12345-0@lo:400:kworker.0 Request processed in 41us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920430.700255:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790920430.700281:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190848 00000100:00100000:0.0:1790920430.700288:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190848 00000100:00100000:0.0:1790920430.700319:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190464 00000100:00100000:0.0:1790920430.700322:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190464 00000100:00100000:0.0:1790920430.700353:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190592 00000100:00100000:0.0:1790920430.700356:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190592 00000100:00100000:0.0:1790920430.700371:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790920430.700376:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972190848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920430.700409:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972190848:12345-0@lo:400:kworker.0 Request processed in 33us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920430.700415:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1790920430.700640:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790920430.700646:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920430.700648:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920430.700662:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790920430.700671:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972190464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920430.700709:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972190464:12345-0@lo:400:kworker.0 Request processed in 40us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920430.700715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790920430.700742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790920430.700781:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972190592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920430.700825:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972190592:12345-0@lo:400:kworker.0 Request processed in 46us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920430.700832:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1790920430.700903:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c63800 x1877915972190720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920430.700917:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972190720:0@lo:400:kworker.0 00000100:00100000:2.0:1790920430.700931:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972190848:0@lo:400:kworker.0 00000100:00100000:2.0:1790920430.700967:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972190592:0@lo:400:kworker.0 00000100:00100000:2.0:1790920430.700976:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972190464:0@lo:400:kworker.0 00010000:00080000:2.0:1790920430.700987:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c62300 x1877915972190976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920430.700997:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972190976:0@lo:400:kworker.0 00000100:00100000:2.0:1790920430.701029:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972190336 00000100:00100000:2.0:1790920430.701034:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972190336 00000100:00100000:2.0:1790920430.701062:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790920430.701069:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972190336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920430.701105:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972190336:12345-0@lo:400:kworker.0 Request processed in 37us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920430.701112:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790920430.701147:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972190336:0@lo:400:kworker.0 00000100:00100000:0.0:1790920431.214694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972191104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920431.214891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920431.215193:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972191104 00000100:00100000:2.0:1790920431.215212:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972191104 00000100:00100000:2.0:1790920431.215286:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790920431.215307:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972191104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920431.215353:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920431.219537:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972191104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4217us (4632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920431.219637:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1790920431.222413:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f525880 x1877915972191104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920431.222454:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972191104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920431.249997:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920431.250042:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920431.250066:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920431.250091:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920431.250386:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920431.250512:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951183488 00000100:00100000:0.0:1790920431.250523:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951183488 00000100:00100000:0.0:1790920431.250572:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 230 00000100:00100000:0.0:1790920431.250582:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951183488:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920431.250656:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951183488:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 75us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920431.250663:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 230 00000100:00100000:3.0:1790920431.250734:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951183744 00000100:00100000:3.0:1790920431.250738:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951183744 00000100:00100000:3.0:1790920431.250821:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951183616 00000100:00080000:0.0:1790920431.250915:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920431.251126:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951183616 00000100:00100000:3.0:1790920431.251161:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:3.0:1790920431.251168:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951183744:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920431.251200:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951183744:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 33us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920431.251206:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:3.0:1790920431.251225:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:3.0:1790920431.251230:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951183616:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920431.251252:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951183616:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 22us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920431.251258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:3.0:1790920431.251279:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951183872 00000100:00100000:3.0:1790920431.251283:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951183872 00000100:00100000:3.0:1790920431.251306:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184000 00000100:00100000:3.0:1790920431.251310:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184000 00000100:00080000:0.0:1790920431.251352:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920431.251356:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920431.251358:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920431.252030:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:3.0:1790920431.252046:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2351:x1877915951183872:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:3.0:1790920431.252137:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a18d 00000100:00080000:3.0:1790920431.252149:0:6689:0:(import.c:65:import_set_state_nolock()) ffff88eb34410000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790920431.252221:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790920431.252564:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+2:2351:x1877915951183872:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 522us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920431.253660:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:2.0:1790920431.253679:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2351:x1877915951184000:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:2.0:1790920431.253706:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a194 00000100:00080000:2.0:1790920431.253716:0:6690:0:(import.c:65:import_set_state_nolock()) ffff88eb07063800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790920431.255380:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00010000:00010000:0.0:1790920431.256360:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1790920431.262889:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790920431.263250:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+2:2351:x1877915951184000:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 9572us (12857us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920431.263261:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00010000:00010000:0.0:1790920431.267948:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920431.664380:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920432.681942:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920432.744942:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972191232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920432.745021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920432.745148:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972191232 00000100:00100000:3.0:1790920432.745157:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972191232 00000100:00100000:3.0:1790920432.745257:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790920432.745269:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972191232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920432.745309:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790920432.748915:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920432.751180:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972191232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5904us (6148us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920432.751195:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1790920432.751524:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e2300 x1877915972191232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920432.751551:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972191232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790920433.709527:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920434.730239:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920435.753010:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920435.817411:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972191360:0@lo:400:kworker.0 00000100:00100000:0.0:1790920435.817517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920435.817611:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972191360 00000100:00100000:1.0:1790920435.817620:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972191360 00000100:00100000:1.0:1790920435.817672:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790920435.817681:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972191360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.818392:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972191360:12345-0@lo:400:kworker.0 Request processed in 710us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920435.818400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790920435.818505:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972191360:0@lo:400:kworker.0 00000100:00100000:0.0:1790920435.818527:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920435.818533:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972191744:0@lo:400:kworker.0 00000100:00100000:0.0:1790920435.818575:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920435.818654:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790920435.818663:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972191872:0@lo:400:kworker.0 00000100:00100000:3.0:1790920435.818694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920435.818744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972191872 00000100:00100000:1.0:1790920435.818765:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972191872 00000100:00100000:1.0:1790920435.818816:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790920435.818823:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972191872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.818862:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972191872:12345-0@lo:400:kworker.0 Request processed in 40us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920435.818868:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790920435.818887:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972191744 00000100:00100000:1.0:1790920435.818891:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972191744 00000100:00100000:1.0:1790920435.818917:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790920435.818924:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972191744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.818953:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972191744:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920435.818959:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790920435.818977:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972191616:0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.819002:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920435.819022:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790920435.819028:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972191488:0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.819049:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920435.819065:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972192000:0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.819085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920435.819112:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972191616 00000100:00100000:1.0:1790920435.819116:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972191616 00000100:00100000:1.0:1790920435.819134:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972191488 00000100:00100000:1.0:1790920435.819136:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972191488 00000100:00100000:1.0:1790920435.819149:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790920435.819154:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972191616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.819188:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972191616:12345-0@lo:400:kworker.0 Request processed in 33us (184us total) trans 0 rc 0/0 00000100:00080000:3.0:1790920435.819199:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920435.819202:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1790920435.819203:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920435.819213:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972192000 00000100:00100000:1.0:1790920435.819213:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790920435.819217:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972192000 00000100:00100000:1.0:1790920435.819219:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972191488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920435.819246:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790920435.819247:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972191488:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920435.819251:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972192000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.819252:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790920435.819278:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972191872:0@lo:400:kworker.0 00000100:00100000:3.0:1790920435.819295:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972192000:12345-0@lo:400:kworker.0 Request processed in 43us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920435.819301:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790920435.819309:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972191488:0@lo:400:kworker.0 00000100:00080000:3.0:1790920435.819316:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790920435.819320:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a29180 x1877915972192000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920435.819329:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972192000:0@lo:400:kworker.0 00000100:00100000:1.0:1790920435.819339:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972191616:0@lo:400:kworker.0 00010000:00080000:0.0:1790920435.819376:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f525500 x1877915972191744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920435.819384:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972191744:0@lo:400:kworker.0 00000001:00100000:2.0:1790920435.854454:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b056702-0296-4eba-8ec3-f47ff1a30c26 00000020:00000080:2.0:1790920435.854463:0:7646:0:(genops.c:885:class_export_put()) final put ffff88eb07062000/2b056702-0296-4eba-8ec3-f47ff1a30c26 00000020:00000080:2.0:1790920435.854487:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb07062000/2b056702-0296-4eba-8ec3-f47ff1a30c26 for lustre-OST0001 00000020:00000080:2.0:1790920435.854534:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb07063800 for lustre-OST0001 00000001:02000400:1.0:1790920436.197564:0:11026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790920436.329861:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920436.329882:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972192128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920436.329948:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920436.330003:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972192128 00000100:00100000:0.0:1790920436.330010:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972192128 00000100:00100000:0.0:1790920436.330053:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790920436.330060:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972192128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920436.330091:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920436.330127:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972192128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920436.330133:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1790920436.330167:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41c62300 x1877915972192128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920436.330185:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972192128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920436.362998:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920436.363042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920436.363063:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184128 00000100:00100000:0.0:1790920436.363074:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184128 00000100:00100000:1.0:1790920436.363086:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920436.363113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184384 00000100:00100000:1.0:1790920436.363118:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184384 00000100:00100000:0.0:1790920436.363140:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 232 00000100:00100000:0.0:1790920436.363161:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2354:x1877915951184128:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920436.363165:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184256 00000100:00100000:1.0:1790920436.363170:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184256 00000100:00100000:1.0:1790920436.363192:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:1.0:1790920436.363201:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951184384:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920436.363248:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951184384:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 49us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920436.363267:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:1.0:1790920436.363288:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:1.0:1790920436.363295:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951184256:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920436.363430:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2354:x1877915951184128:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 271us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920436.363438:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 232 00000100:00080000:2.0:1790920436.365842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920436.366115:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951184256:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 2811us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920436.366130:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 94 00000001:00100000:1.0:1790920436.385118:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b056702-0296-4eba-8ec3-f47ff1a30c26 00000020:00000080:1.0:1790920436.385126:0:6712:0:(genops.c:885:class_export_put()) final put ffff88eb34411000/2b056702-0296-4eba-8ec3-f47ff1a30c26 00000020:00000080:2.0:1790920436.385178:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb34411000/2b056702-0296-4eba-8ec3-f47ff1a30c26 for lustre-OST0000 00000020:00000080:2.0:1790920436.385225:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb34410000 for lustre-OST0000 00010000:00010000:0.0:1790920436.777087:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920437.808320:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920437.870944:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972192256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920437.871043:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920437.871726:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972192256 00000100:00100000:3.0:1790920437.871738:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972192256 00000100:00100000:3.0:1790920437.871836:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790920437.871847:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972192256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920437.871893:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920437.871961:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972192256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920437.871969:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1790920437.872023:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e1c00 x1877915972192256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920437.872046:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972192256:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790920437.872142:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790920438.825608:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920439.853932:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790920439.998620:0:11176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce60788c0 20000000:00000080:2.0:1790920439.998669:0:11176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88eb3f599c00 uarg=0000000000000000 20000000:01000000:2.0:1790920439.998722:0:11176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790920439.998738:0:11176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790920439.998773:0:11176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790920440.000730:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1790920440.001578:0:11176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790920440.008203:0:11176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790920440.008262:0:11176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008294:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008304:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a147 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008313:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a155 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008320:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a163 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008328:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008337:0:11176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008414:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008436:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 12 pid: 5840 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920440.008455:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192384:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920440.008683:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a163 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008693:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a163 expref: 18 pid: 5840 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920440.008703:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192512:0@lo:104: 00000100:00100000:2.0:1790920440.008826:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790920440.008883:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a155 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.008892:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a155 expref: 18 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920440.008900:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192640:0@lo:104: 00000100:00100000:2.0:1790920440.009132:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790920440.009160:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a147 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.009167:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a147 expref: 18 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920440.009175:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192768:0@lo:104: 00000100:00100000:2.0:1790920440.009212:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790920440.009232:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920440.009337:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972192512 00000100:00100000:1.0:1790920440.009347:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972192512 00000100:00100000:1.0:1790920440.009394:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972192640 00000100:00100000:1.0:1790920440.009397:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972192640 00000100:00100000:1.0:1790920440.009405:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972192768 00000100:00100000:1.0:1790920440.009407:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972192768 00000100:00100000:1.0:1790920440.009420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790920440.009435:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:11176:x1877915972192512:12345-0@lo:104: 00010000:00010000:1.0:1790920440.009451:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009507:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790920440.009514:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:11176:x1877915972192512:12345-0@lo:104: Request processed in 85us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920440.009520:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790920440.009541:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790920440.009546:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:11176:x1877915972192640:12345-0@lo:104: 00010000:00010000:1.0:1790920440.009563:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009598:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790920440.009603:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:11176:x1877915972192640:12345-0@lo:104: Request processed in 57us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920440.009609:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790920440.009623:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790920440.009643:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:11176:x1877915972192768:12345-0@lo:104: 00010000:00010000:1.0:1790920440.009658:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009684:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790920440.009688:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:11176:x1877915972192768:12345-0@lo:104: Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920440.009694:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790920440.009716:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790920440.009722:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009731:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920440.009736:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009772:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920440.009781:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920440.009795:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790920440.009832:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009839:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920440.009866:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009874:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546a163 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a16a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009891:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790920440.009895:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009913:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031600 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920440.009917:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009926:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920440.009933:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920440.009938:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790920440.009966:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.009971:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920440.009996:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.010003:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00031600/0x2a4915844546a155 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a15c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.010013:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920440.010015:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.010022:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37200 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920440.010025:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.010032:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920440.010038:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920440.010044:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790920440.010055:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.010060:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920440.010066:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.010071:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546a147 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a14e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.010084:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920440.010091:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920440.010093:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920440.010101:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920440.010119:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972193024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920440.010159:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920440.010199:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972193152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920440.010223:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790920440.010482:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 12 pid: 5839 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920440.010507:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192896:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920440.010569:0:11176:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb20b70840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920440.010597:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192512:0@lo:104: 00000100:00100000:2.0:1790920440.010607:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192640:0@lo:104: 00000100:00100000:1.0:1790920440.010641:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920440.010656:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972193280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920440.010834:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192768:0@lo:104: 00000100:00100000:1.0:1790920440.011028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920440.011088:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193024 00000100:00100000:1.0:1790920440.011095:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193024 00010000:00010000:1.0:1790920440.011127:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a163 expref: 19 pid: 5840 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920440.011156:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193152 00000100:00100000:1.0:1790920440.011159:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193152 00010000:00010000:1.0:1790920440.011171:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a155 expref: 20 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920440.011181:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193280 00000100:00100000:1.0:1790920440.011183:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193280 00010000:00010000:1.0:1790920440.011193:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a147 expref: 21 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920440.011206:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790920440.011213:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+21:3307:x1877915972193024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790920440.011229:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920440.011235:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a163 expref: 21 pid: 5840 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920440.011335:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790920440.011344:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+21:3304:x1877915972193152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790920440.011352:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920440.011357:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a155 expref: 21 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.011370:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a155 expref: 21 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.011387:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029ef200/0x2a4915844546a15c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a155 expref: 21 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.011404:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920440.011442:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+20:3304:x1877915972193152:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920440.011449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790920440.011467:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790920440.011472:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972193280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790920440.011478:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920440.011481:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a147 expref: 19 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.011497:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a147 expref: 19 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.011506:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56a600/0x2a4915844546a14e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a147 expref: 19 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920440.011515:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920440.011535:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:3304:x1877915972193280:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920440.011541:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1790920440.011589:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a163 expref: 17 pid: 5840 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.011599:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb41e36800/0x2a4915844546a16a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a163 expref: 17 pid: 5840 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.011607:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920440.011876:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3307:x1877915972193024:12345-0@lo:103:ldlm_bl.0 Request processed in 661us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920440.011884:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790920440.011972:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972193280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920440.011982:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972193152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920440.016728:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972193024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920440.017418:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920440.017492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920440.017588:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192384:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920440.017599:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1877915972192896:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920440.017660:0:11176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920440.018080:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184512 00000100:00100000:1.0:1790920440.018090:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184512 00010000:00010000:1.0:1790920440.018140:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 13 pid: 5840 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920440.018217:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184640 00000100:00100000:1.0:1790920440.018221:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184640 00010000:00010000:1.0:1790920440.018247:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 14 pid: 5839 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920440.018283:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:3.0:1790920440.018299:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+14:2355:x1877915951184512:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920440.018321:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920440.018331:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 14 pid: 5840 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018346:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 14 pid: 5840 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018373:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb41e36000/0x2a4915844546a17f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa15 expref: 14 pid: 5840 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018395:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920440.018490:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951184512:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 194us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.018498:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:3.0:1790920440.018520:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:3.0:1790920440.018527:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:2355:x1877915951184640:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920440.018536:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920440.018540:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 12 pid: 5839 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018549:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 12 pid: 5839 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018559:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb41e37c00/0x2a4915844546a140 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9dd expref: 12 pid: 5839 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018594:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018604:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018622:0:8460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018639:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018648:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018666:0:8460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018673:0:8460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920440.018678:0:8460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018687:0:8460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018702:0:8460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920440.018713:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920440.018736:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:2355:x1877915951184640:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 209us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.018817:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00010000:00010000:0.0:1790920440.020390:0:11176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920440.020411:0:11176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920440.020418:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56a000/0x2a4915844546a19b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920440.873124:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920440.937991:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972193408:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938097:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920440.938160:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972193920:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920440.938226:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790920440.938232:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972193536:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938255:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920440.938274:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41fb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972194048:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938301:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920440.938338:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972193664:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920440.938383:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920440.938389:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972193792:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938409:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920440.938448:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193408 00000100:00100000:3.0:1790920440.938459:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193408 00000100:00100000:3.0:1790920440.938519:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790920440.938530:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3306:x1877915972193408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938593:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3306:x1877915972193408:12345-0@lo:400:kworker.0 Request processed in 64us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.938600:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790920440.938662:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193920 00000100:00100000:3.0:1790920440.938666:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193920 00000100:00100000:3.0:1790920440.938699:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193536 00000100:00100000:3.0:1790920440.938717:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193536 00000100:00100000:3.0:1790920440.938733:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193664 00000100:00100000:3.0:1790920440.938735:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193664 00000100:00100000:3.0:1790920440.938773:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790920440.938780:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972193920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938814:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972193920:12345-0@lo:400:kworker.0 Request processed in 35us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.938820:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790920440.938832:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790920440.938837:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972193536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.938862:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972193536:12345-0@lo:400:kworker.0 Request processed in 25us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.938867:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790920440.942279:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790920440.942313:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972193664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.942453:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972193664:12345-0@lo:400:kworker.0 Request processed in 156us (4087us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.942462:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790920440.942522:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194048 00000100:00100000:3.0:1790920440.942530:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194048 00000100:00100000:3.0:1790920440.942575:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972193792 00000100:00100000:3.0:1790920440.942578:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972193792 00000100:00100000:3.0:1790920440.942600:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790920440.942621:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972194048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.945153:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972194048:12345-0@lo:400:kworker.0 Request processed in 2533us (6837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.945170:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790920440.945224:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790920440.945239:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972193792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.945287:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972193792:12345-0@lo:400:kworker.0 Request processed in 55us (6876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920440.945294:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1790920440.945345:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790920440.945351:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790920440.945355:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790920440.945414:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb10a28700 x1877915972193792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920440.945433:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972193792:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.945449:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972193664:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.945498:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972193536:0@lo:400:kworker.0 00010000:00080000:3.0:1790920440.945512:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41fb2d80 x1877915972194048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920440.945522:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972194048:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.945534:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972193408:0@lo:400:kworker.0 00000100:00100000:3.0:1790920440.945545:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972193920:0@lo:400:kworker.0 00000100:00100000:3.0:1790920441.040378:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920441.040599:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184768 00000100:00100000:2.0:1790920441.040623:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184768 00000100:00100000:2.0:1790920441.040691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 234 00000100:00100000:2.0:1790920441.040702:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:5595:x1877915951184768:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920441.040726:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920441.040783:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa3f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.040822:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.040837:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.040867:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56bc00, rc 0) 00000100:00100000:2.0:1790920441.041128:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951184768:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 426us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920441.041136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 234 00000100:00100000:3.0:1790920441.046235:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920441.046329:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951184896 00000100:00100000:0.0:1790920441.046343:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951184896 00000100:00100000:0.0:1790920441.046417:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 235 00000100:00100000:0.0:1790920441.046429:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951184896:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920441.046894:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951184896:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 464us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920441.046903:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 235 00000100:00100000:0.0:1790920441.050365:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920441.051239:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185024 00000100:00100000:1.0:1790920441.051256:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185024 00000100:00100000:1.0:1790920441.051330:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:1.0:1790920441.051343:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951185024:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920441.053860:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951185024:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 1115us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920441.054642:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:1.0:1790920441.063015:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920441.065810:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185152 00000100:00100000:3.0:1790920441.065833:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185152 00000100:00100000:3.0:1790920441.065928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 237 00000100:00100000:3.0:1790920441.065942:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951185152:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920441.065991:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920441.066021:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa46 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920441.066182:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920441.066197:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920441.066208:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36000, rc 0) 00000100:00100000:3.0:1790920441.066307:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951185152:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 367us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920441.066315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 237 00000100:00100000:2.0:1790920441.074701:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920441.074768:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185280 00000100:00100000:2.0:1790920441.074782:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185280 00000100:00100000:2.0:1790920441.074845:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 238 00000100:00100000:2.0:1790920441.074859:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951185280:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920441.075238:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951185280:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 380us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920441.075248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 238 00000100:00100000:2.0:1790920441.082840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920441.082996:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185408 00000100:00100000:1.0:1790920441.083009:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185408 00000100:00100000:1.0:1790920441.083073:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 239 00000100:00100000:1.0:1790920441.083085:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951185408:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920441.083855:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951185408:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 765us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920441.083866:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 239 00000100:00100000:2.0:1790920441.449963:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972194176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920441.450064:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920441.450181:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194176 00000100:00100000:2.0:1790920441.450191:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194176 00000100:00100000:2.0:1790920441.451035:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790920441.451049:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972194176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920441.451097:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920441.451229:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972194176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920441.451237:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1790920441.452462:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f654e00 x1877915972194176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920441.452494:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972194176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920441.490690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920441.490794:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920441.490833:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185664 00000100:00100000:0.0:1790920441.490847:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185664 00000100:00100000:0.0:1790920441.490921:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185536 00000100:00100000:0.0:1790920441.490925:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185536 00000100:00100000:0.0:1790920441.490946:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:0.0:1790920441.490958:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951185664:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920441.491051:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951185664:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920441.491059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:0.0:1790920441.491078:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:0.0:1790920441.491084:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951185536:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920441.491104:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951185536:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 21us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920441.491110:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00080000:0.0:1790920441.491127:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1790920441.836268:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790920441.836276:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3a4ce000 from 7 10000000:01000000:0.0:1790920441.836281:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920441.836333:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920441.836344:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920441.836355:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920441.836390:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790920441.836461:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920441.836528:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f42600 going to sleep for 11 seconds 00000100:00100000:2.0:1790920441.836826:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194304 00000100:00100000:2.0:1790920441.836841:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194304 00000100:00100000:2.0:1790920441.836995:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790920441.837007:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972194304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920441.837022:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920441.837036:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a1b0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.837064:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.837076:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.837085:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a400, rc 0) 00000100:00100000:2.0:1790920441.837143:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972194304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920441.837151:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790920441.837552:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920441.837572:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920441.837606:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920441.837688:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920441.837728:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920441.837835:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920441.837911:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194432 00000100:00100000:0.0:1790920441.837917:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194432 00000100:00100000:0.0:1790920441.837950:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790920441.837959:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972194432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920441.838226:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972194432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920441.838235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790920441.838517:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920441.838551:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920441.839448:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920441.839492:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920441.839500:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194560 00000100:00100000:2.0:1790920441.839507:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194560 00000100:00100000:2.0:1790920441.839555:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790920441.839564:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972194560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790920441.839790:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972194560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920441.839798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790920441.839847:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790920441.841195:0:11244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790920441.841347:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790920441.841373:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790920441.841385:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.841407:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920441.841419:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790920441.841422:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb05888000 from 7 10000000:01000000:2.0:1790920441.841426:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790920441.841460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.841469:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.841479:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920441.841504:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790920441.841562:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920441.841629:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920441.841682:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194688 00000100:00100000:1.0:1790920441.841690:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194688 00000100:00100000:1.0:1790920441.841735:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790920441.841744:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972194688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920441.841797:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920441.841812:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a1be expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920441.841851:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a1be expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920441.841862:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a1be expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920441.841878:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029efe00, rc 0) 00000100:00100000:1.0:1790920441.841927:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972194688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920441.841934:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790920441.842066:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920441.842080:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920441.842088:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920441.842136:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920441.842165:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920441.842205:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb084dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920441.842237:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194816 00000100:00100000:1.0:1790920441.842243:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194816 00000100:00100000:1.0:1790920441.842270:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790920441.842276:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972194816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920441.842563:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972194816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920441.842572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790920441.843951:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920441.843994:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920441.844038:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920441.844067:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8780 going to sleep for 11 seconds 00000100:00100000:2.0:1790920441.844075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972194944 00000100:00100000:2.0:1790920441.844081:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972194944 00000100:00100000:2.0:1790920441.844123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790920441.844133:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972194944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790920441.844363:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972194944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920441.844373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790920441.844455:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972194944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790920441.849563:0:11246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790920441.850942:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790920441.850974:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790920441.850988:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920441.851002:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920441.851015:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790920441.851020:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb09ba1000 from 7 10000000:01000000:0.0:1790920441.851023:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920441.851065:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920441.851073:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920441.851101:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920441.851129:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972195072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790920441.851189:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920441.851233:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f42300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920441.853413:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195072 00000100:00100000:1.0:1790920441.853429:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195072 00000100:00100000:1.0:1790920441.853492:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790920441.853502:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972195072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920441.853521:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920441.853545:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a1cc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920441.853576:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a1cc expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920441.853587:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a1cc expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920441.853608:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029ef400, rc 0) 00000100:00100000:1.0:1790920441.853699:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972195072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920441.853706:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790920441.853738:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972195072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790920441.853786:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920441.853796:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920441.854011:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972195200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920441.854045:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920441.854082:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f42300 going to sleep for 11 seconds 00000100:00100000:3.0:1790920441.854122:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195200 00000100:00100000:3.0:1790920441.854127:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195200 00000100:00100000:3.0:1790920441.854173:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790920441.854180:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972195200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920441.854435:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972195200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920441.854443:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790920441.854642:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972195200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920441.854671:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972195328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920441.854709:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920441.854731:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a46900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920441.854954:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195328 00000100:00100000:3.0:1790920441.854959:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195328 00000100:00100000:3.0:1790920441.854989:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1790920441.854996:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972195328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920441.855136:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972195328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920441.855142:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790920441.856741:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972195328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790920441.857740:0:11247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790920441.858501:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790920441.858527:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790920441.858538:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920441.858552:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920441.902345:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920442.934984:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920442.984952:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920442.984983:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972195456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790920442.985081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920442.985194:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195456 00000100:00100000:2.0:1790920442.985205:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195456 00000100:00100000:2.0:1790920442.985285:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790920442.985297:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972195456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920442.985344:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920442.985393:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972195456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920442.985402:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1790920442.985428:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790920442.985470:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f654000 x1877915972195456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920442.985494:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972195456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790920443.945093:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790920444.583526:0:11375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790920444.971315:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920445.993006:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920446.057920:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972195968:0@lo:400:kworker.0 00000100:00100000:0.0:1790920446.058034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920446.058112:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790920446.058119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972195840:0@lo:400:kworker.0 00000100:00100000:0.0:1790920446.058148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920446.058189:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195840 00000100:00100000:0.0:1790920446.058199:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195840 00000100:00100000:0.0:1790920446.058269:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790920446.058280:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972195840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920446.058336:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972195840:12345-0@lo:400:kworker.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920446.058344:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790920446.058397:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972195840:0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.058500:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972195584:0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.058552:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920446.058606:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972196096:0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.058631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920446.058653:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790920446.058659:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972195712:0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.058679:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920446.058695:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972196224:0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.058717:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920446.058769:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195968 00000100:00100000:3.0:1790920446.058774:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195968 00000100:00100000:3.0:1790920446.058803:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196224 00000100:00100000:3.0:1790920446.058806:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196224 00000100:00100000:3.0:1790920446.058826:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790920446.058832:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972195968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.058869:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972195968:12345-0@lo:400:kworker.0 Request processed in 37us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920446.058875:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790920446.058887:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790920446.058891:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972196224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.058915:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972196224:12345-0@lo:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920446.058920:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790920446.058934:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196096 00000100:00100000:3.0:1790920446.058937:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196096 00000100:00100000:3.0:1790920446.058956:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195712 00000100:00100000:3.0:1790920446.058958:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195712 00000100:00100000:3.0:1790920446.058969:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790920446.058975:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972196096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.059019:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972196096:12345-0@lo:400:kworker.0 Request processed in 44us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920446.059026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790920446.059039:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790920446.059044:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972195712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.059070:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972195712:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920446.059075:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790920446.059122:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972195712:0@lo:400:kworker.0 00010000:00080000:3.0:1790920446.059137:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e1c00 x1877915972196224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920446.059147:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972196224:0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.059155:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972196096:0@lo:400:kworker.0 00000100:00080000:2.0:1790920446.059335:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920446.059342:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920446.059353:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920446.061520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972195584 00000100:00100000:0.0:1790920446.061545:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972195584 00000100:00100000:0.0:1790920446.065479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1790920446.065524:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972195584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920446.065676:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972195584:12345-0@lo:400:kworker.0 Request processed in 182us (7121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920446.065685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:0.0:1790920446.065830:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb070e2d80 x1877915972195968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920446.065850:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972195968:0@lo:400:kworker.0 00000100:00100000:2.0:1790920446.066037:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972195584:0@lo:400:kworker.0 00000100:00100000:3.0:1790920446.571320:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972196352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920446.571438:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920446.571704:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196352 00000100:00100000:2.0:1790920446.571716:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196352 00000100:00100000:2.0:1790920446.571858:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790920446.571871:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972196352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920446.571924:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920446.588422:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972196352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16537us (16969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920446.588443:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1790920446.593631:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f524700 x1877915972196352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920446.593672:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972196352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920446.603961:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920446.604015:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920446.604050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920446.604158:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185792 00000100:00100000:0.0:1790920446.604171:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185792 00000100:00100000:0.0:1790920446.604236:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 250 00000100:00100000:0.0:1790920446.604249:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951185792:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920446.604362:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951185792:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 116us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920446.604370:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 250 00000100:00100000:3.0:1790920446.604790:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951185920 00000100:00100000:3.0:1790920446.604795:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951185920 00000100:00100000:3.0:1790920446.604845:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951186048 00000100:00100000:3.0:1790920446.604848:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951186048 00000100:00100000:3.0:1790920446.604864:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:3.0:1790920446.604871:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951185920:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920446.604925:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951185920:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 55us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920446.604932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:3.0:1790920446.604947:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:3.0:1790920446.604953:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951186048:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920446.604973:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951186048:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 21us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920446.604978:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00080000:0.0:1790920446.605134:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790920447.016979:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920448.041157:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920448.105045:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920448.105298:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972196480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920448.105396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920448.107941:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196480 00000100:00100000:2.0:1790920448.107959:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196480 00000100:00100000:2.0:1790920448.108116:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790920448.108128:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972196480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920448.108178:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920448.108280:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972196480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920448.108287:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1790920448.111391:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f654000 x1877915972196480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920448.111431:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972196480:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790920448.115295:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790920449.066851:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790920449.521939:0:11475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:54:07 (1790920447) === 00000100:00100000:0.0:1790920449.745232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920449.745910:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951186304 00000100:00100000:1.0:1790920449.745925:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951186304 00000100:00100000:1.0:1790920449.746018:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1790920449.746034:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:9683:x1877915951186304:12345-192.168.204.34@tcp:700:mkdir.0 00000100:00100000:1.0:1790920449.746159:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:9683:x1877915951186304:12345-192.168.204.34@tcp:700:mkdir.0 Request processed in 129us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920449.746188:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00080000:0.0:1790920449.746573:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920449.747508:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920449.747548:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951186176 00000100:00100000:1.0:1790920449.747556:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951186176 00000100:00100000:1.0:1790920449.747611:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1790920449.747622:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951186176:12345-192.168.204.34@tcp:41:mkdir.0 00000004:00000024:1.0:1790920449.747673:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790920449.747867:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951186176:12345-192.168.204.34@tcp:41:mkdir.0 Request processed in 247us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920449.747876:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1790920449.749831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920449.749870:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951186560 00000100:00100000:1.0:1790920449.749880:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951186560 00000100:00100000:1.0:1790920449.749932:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:1.0:1790920449.749943:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:9683:x1877915951186560:12345-192.168.204.34@tcp:36:mkdir.0 00010000:00010000:1.0:1790920449.750017:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920449.750521:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a0bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9c8 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.750550:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2cc00) 00010000:00010000:1.0:1790920449.750563:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920449.751537:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.751555:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.751576:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.751685:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.751694:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.751701:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920449.753596:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790920449.753612:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.753622:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.753631:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.753639:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139ca00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920449.753643:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.753651:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.753670:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920449.753674:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920449.753686:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.753693:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a1da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790920449.753725:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b5af278 reply state 000000005a2cf557 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920449.753734:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790920449.753871:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9683:x1877915951186560:12345-192.168.204.34@tcp:36:mkdir.0 Request processed in 3926us (4046us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790920449.753883:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00010000:00010000:1.0:1790920449.755880:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.755895:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.755903:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.755910:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139cc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920449.755914:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.755923:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.755944:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88eb01486f00) 00010000:00010000:1.0:1790920449.755947:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920449.755951:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.755986:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a1e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920449.766678:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920449.770895:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951186688 00000100:00100000:0.0:1790920449.770920:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951186688 00000100:00100000:0.0:1790920449.771016:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1790920449.771030:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:9684:x1877915951186688:12345-192.168.204.34@tcp:101:chmod.0 00010000:00010000:0.0:1790920449.771061:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920449.771097:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a1e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa4d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920449.771189:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a1ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920449.771206:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920449.771224:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920449.771268:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790920449.771272:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920449.771317:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920449.771360:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a1e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa4d expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920449.771382:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a1ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa4d expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920449.771390:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920449.771393:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920449.771397:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031600, rc 0) 00000100:00100000:0.0:1790920449.771498:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9684:x1877915951186688:12345-192.168.204.34@tcp:101:chmod.0 Request processed in 472us (4831us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920449.771505:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:1.0:1790920449.775451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920449.775539:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951186944 00000100:00100000:2.0:1790920449.775553:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951186944 00000100:00100000:2.0:1790920449.775619:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1790920449.775631:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9684:x1877915951186944:12345-192.168.204.34@tcp:36:chmod.0 00010000:00010000:2.0:1790920449.775706:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920449.775740:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a1ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa4d expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.775785:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920449.775818:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920449.775850:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.775866:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.775878:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920449.778445:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000488d9a85 reply state 00000000b41027e3 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920449.778472:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790920449.778492:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790920449.778637:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:9684:x1877915951186944:12345-192.168.204.34@tcp:36:chmod.0 Request processed in 3001us (3203us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790920449.778649:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00010000:00010000:1.0:1790920449.782284:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.782310:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.782320:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.782329:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920449.782334:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.782343:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.782364:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2c600) 00010000:00010000:1.0:1790920449.782368:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790920449.782374:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.782381:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a1f6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920449.825424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920449.825826:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951187072 00000100:00100000:2.0:1790920449.825837:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951187072 00000100:00100000:2.0:1790920449.825898:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1790920449.825908:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9685:x1877915951187072:12345-192.168.204.34@tcp:101:chown.0 00010000:00010000:2.0:1790920449.825933:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920449.825958:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a1fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa54 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.826024:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.826037:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.826075:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920449.826111:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790920449.826115:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920449.826150:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.826175:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a1fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa54 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.826194:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa54 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.826203:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920449.826205:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920449.826209:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a600, rc 0) 00000100:00100000:2.0:1790920449.826276:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:9685:x1877915951187072:12345-192.168.204.34@tcp:101:chown.0 Request processed in 369us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920449.826284:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:0.0:1790920449.840666:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920449.841076:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951187200 00000100:00100000:2.0:1790920449.841087:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951187200 00000100:00100000:2.0:1790920449.841151:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1790920449.841163:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:9685:x1877915951187200:12345-192.168.204.34@tcp:101:chown.0 00010000:00010000:2.0:1790920449.841250:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920449.841274:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a20b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa5b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841371:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841391:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841481:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841498:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841505:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841511:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841595:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841604:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841611:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920449.841642:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790920449.841647:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920449.841668:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841689:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841695:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841701:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841708:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56aa00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920449.841712:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841719:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841733:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920449.841736:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920449.841740:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841779:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841793:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841799:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841805:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841818:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920449.841821:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841827:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841835:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920449.841838:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920449.841840:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841846:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841878:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a20b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa5b expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.841891:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa5b expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920449.842246:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c700) 00010000:00010000:2.0:1790920449.842249:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920449.842251:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a800, rc 0) 00000100:00100000:2.0:1790920449.842324:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:9685:x1877915951187200:12345-192.168.204.34@tcp:101:chown.0 Request processed in 1163us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920449.842332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:3.0:1790920449.846507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920449.846822:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951187456 00000100:00100000:1.0:1790920449.846847:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951187456 00000100:00100000:1.0:1790920449.846905:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1790920449.846916:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:9685:x1877915951187456:12345-192.168.204.34@tcp:36:chown.0 00010000:00010000:1.0:1790920449.846969:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920449.846996:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa5b expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.847016:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c700) 00010000:00010000:1.0:1790920449.847027:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920449.847054:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.847068:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920449.847078:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790920449.900799:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1790920449.900935:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bab1ef64 reply state 00000000529d7da8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920449.900953:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790920449.900974:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1790920449.901861:0:5845:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790920449.901899:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9685:x1877915951187456:12345-192.168.204.34@tcp:36:chown.0 Request processed in 54975us (55391us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790920449.901911:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00010000:00010000:3.0:1790920449.902466:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920449.902480:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920449.902488:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920449.902495:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139cc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920449.902500:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920449.902508:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920449.902562:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:3.0:1790920449.902565:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790920449.902572:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920449.902584:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a227 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920449.944640:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920449.944848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951187584 00000100:00100000:2.0:1790920449.944865:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951187584 00000100:00100000:2.0:1790920449.944946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:2.0:1790920449.944960:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:9686:x1877915951187584:12345-192.168.204.34@tcp:101:touch.500 00010000:00010000:2.0:1790920449.944997:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920449.945028:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a22e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa62 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790920449.948694:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3587us 00010000:00010000:2.0:1790920450.004298:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004328:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004342:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004360:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004367:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004374:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004820:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004830:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004848:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920450.004879:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790920450.004884:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920450.004934:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004949:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004957:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004965:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004972:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56aa00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920450.004977:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.004986:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005001:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920450.005005:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920450.005010:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005017:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005041:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005329:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005337:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005343:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920450.005347:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005353:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005363:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920450.005366:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920450.005369:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005374:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a23c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005424:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a22e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa62 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005452:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa62 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.005472:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:2.0:1790920450.005474:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790920450.005477:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ba00, rc 0) 00000100:00100000:2.0:1790920450.005579:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9686:x1877915951187584:12345-192.168.204.34@tcp:101:touch.500 Request processed in 60620us (60952us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920450.005589:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1790920450.011377:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920450.011591:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951187840 00000100:00100000:0.0:1790920450.011605:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951187840 00000100:00100000:0.0:1790920450.011669:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:0.0:1790920450.011681:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9686:x1877915951187840:12345-192.168.204.34@tcp:101:touch.500 00010000:00010000:0.0:1790920450.011718:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920450.011784:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a24a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.012295:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.012314:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.012471:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.012493:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.012501:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.012508:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790920450.015665:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1790920450.018768:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a25f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018801:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018819:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018875:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018884:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018890:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018897:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920450.018919:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018928:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018943:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:0.0:1790920450.018947:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920450.018953:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.018961:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a251 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920450.018988:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e6252e9 reply state 00000000cfb04934 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920450.019000:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790920450.019062:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a24a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa69 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.019081:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa69 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.019089:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb0856f600) 00010000:00010000:0.0:1790920450.019092:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920450.019095:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb421cf200, rc 0) 00000100:00100000:0.0:1790920450.019357:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:9686:x1877915951187840:12345-192.168.204.34@tcp:101:touch.500 Request processed in 7675us (7991us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790920450.019368:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00010000:00010000:1.0:1790920450.024625:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.024666:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.024676:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.024684:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920450.024690:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.024700:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.024721:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff88eb0856f200) 00010000:00010000:1.0:1790920450.024725:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920450.024731:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.024738:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a258 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920450.031565:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920450.031702:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951188096 00000100:00100000:2.0:1790920450.031716:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951188096 00000100:00100000:2.0:1790920450.031836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:2.0:1790920450.031851:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:9686:x1877915951188096:12345-192.168.204.34@tcp:36:touch.500 00010000:00010000:2.0:1790920450.031941:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920450.031976:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a25f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa69 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.032003:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb0856f600) 00010000:00010000:2.0:1790920450.032017:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920450.032081:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.032098:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.032111:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920450.032301:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029246f6c reply state 000000002825fc5e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920450.032340:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920450.032477:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:9686:x1877915951188096:12345-192.168.204.34@tcp:36:touch.500 Request processed in 629us (929us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790920450.032485:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00010000:00010000:1.0:1790920450.041121:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.041146:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.041156:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.041189:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920450.041194:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.041203:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.041225:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:1.0:1790920450.041228:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920450.041240:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.041247:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a26d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920450.041662:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920450.041968:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951188224 00000100:00100000:2.0:1790920450.041984:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951188224 00000100:00100000:2.0:1790920450.042063:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:2.0:1790920450.042077:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:9686:x1877915951188224:12345-192.168.204.34@tcp:101:touch.500 00010000:00010000:2.0:1790920450.042115:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920450.042144:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa70 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.042227:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa70 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.042244:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa70 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.042267:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:2.0:1790920450.042270:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920450.042273:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b600, rc 0) 00000100:00100000:2.0:1790920450.042367:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:9686:x1877915951188224:12345-192.168.204.34@tcp:101:touch.500 Request processed in 292us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920450.042375:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:3.0:1790920450.049906:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920450.050076:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951188352 00000100:00100000:0.0:1790920450.050090:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951188352 00000100:00100000:0.0:1790920450.050156:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1790920450.050168:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1877915951188352:12345-192.168.204.34@tcp:8:touch.500 00010000:00080000:0.0:1790920450.050211:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:0.0:1790920450.050263:0:6689:0:(genops.c:1384:class_connect()) connect: client 23f7dc83-f18d-4470-88f4-3dd4c845ced7, cookie 0x2a4915844546a27b 00002000:00100000:0.0:1790920450.050281:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 23f7dc83-f18d-4470-88f4-3dd4c845ced7/ffff88eb07062000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790920450.050314:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790920450.050635:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790920450.050677:0:6689:0:(import.c:65:import_set_state_nolock()) ffff88eb07066000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920450.050819:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2351:x1877915951188352:12345-192.168.204.34@tcp:8:touch.500 Request processed in 651us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920450.050828:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1790920450.077272:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920450.077427:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951188480 00000100:00100000:3.0:1790920450.077453:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951188480 00000100:00100000:3.0:1790920450.077558:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:3.0:1790920450.077572:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:0:x1877915951188480:12345-192.168.204.34@tcp:2:touch.500 00000100:00080000:0.0:1790920450.078462:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790920450.094738:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790920450.154839:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000001:00080000:0.0:1790920450.154866:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1790920450.155234:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:0:x1877915951188480:12345-192.168.204.34@tcp:2:touch.500 Request processed in 77656us (77966us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790920450.155247:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:1.0:1790920450.158906:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920450.161413:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951188736 00000100:00100000:0.0:1790920450.161451:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951188736 00000100:00100000:2.0:1790920450.162856:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:2.0:1790920450.162873:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:9686:x1877915951188736:12345-192.168.204.34@tcp:35:touch.500 00000100:00100000:2.0:1790920450.163739:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:9686:x1877915951188736:12345-192.168.204.34@tcp:35:touch.500 Request processed in 864us (4844us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790920450.163785:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:3.0:1790920450.178956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920450.179082:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951188864 00000100:00100000:1.0:1790920450.179099:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951188864 00000100:00100000:1.0:1790920450.179180:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:1.0:1790920450.179194:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:9687:x1877915951188864:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:1.0:1790920450.179227:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920450.179258:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa77 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.179350:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.179387:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.179403:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920450.179472:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790920450.179478:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920450.179534:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.179569:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139ca00/0x2a4915844546a282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa77 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.179591:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa77 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.179600:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:1.0:1790920450.179604:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790920450.179609:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139d400, rc 0) 00000100:00100000:1.0:1790920450.179705:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:9687:x1877915951188864:12345-192.168.204.34@tcp:101:rm.0 Request processed in 514us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920450.179714:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1790920450.184414:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920450.185328:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951189120 00000100:00100000:3.0:1790920450.185344:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951189120 00000100:00100000:3.0:1790920450.185428:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:3.0:1790920450.185465:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:9687:x1877915951189120:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:3.0:1790920450.185496:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920450.185525:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa7e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920450.185967:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790920450.186259:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a290 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa7e expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.186302:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:3.0:1790920450.186306:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790920450.186313:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa7e expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.186328:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37800, rc 0) 00000100:00100000:3.0:1790920450.186517:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:9687:x1877915951189120:12345-192.168.204.34@tcp:101:rm.0 Request processed in 1065us (2116us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1790920450.186526:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:0.0:1790920450.192256:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920450.192427:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951189248 00000100:00100000:1.0:1790920450.192451:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951189248 00000100:00100000:1.0:1790920450.192969:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:1.0:1790920450.192982:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:9687:x1877915951189248:12345-192.168.204.34@tcp:37:rm.0 00000100:00100000:1.0:1790920450.199218:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:9687:x1877915951189248:12345-192.168.204.34@tcp:37:rm.0 Request processed in 6220us (6961us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920450.199251:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1790920450.203293:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920450.203386:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951189504 00000100:00100000:2.0:1790920450.203402:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951189504 00000100:00100000:2.0:1790920450.203505:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:2.0:1790920450.203519:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:9687:x1877915951189504:12345-192.168.204.34@tcp:35:rm.0 00000100:00100000:2.0:1790920450.204217:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:9687:x1877915951189504:12345-192.168.204.34@tcp:35:rm.0 Request processed in 698us (937us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790920450.204228:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1790920450.207939:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920450.208131:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951189760 00000100:00100000:2.0:1790920450.208145:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951189760 00000100:00100000:2.0:1790920450.208224:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:2.0:1790920450.208237:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:9687:x1877915951189760:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:2.0:1790920450.208271:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920450.208300:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a29e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.208426:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a2a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.208631:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.208719:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920450.208737:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790920450.209130:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a29e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa85 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.209155:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa85 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.209164:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:2.0:1790920450.209167:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790920450.209171:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a000, rc 0) 00000100:00100000:2.0:1790920450.209308:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:9687:x1877915951189760:12345-192.168.204.34@tcp:101:rm.0 Request processed in 1073us (1382us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790920450.209318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:3.0:1790920450.216914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920450.217114:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951189888 00000100:00100000:1.0:1790920450.217129:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951189888 00000100:00100000:1.0:1790920450.217202:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:1.0:1790920450.217213:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:9687:x1877915951189888:12345-192.168.204.34@tcp:41:rm.0 00000004:00000024:1.0:1790920450.217305:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1790920450.217392:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:9687:x1877915951189888:12345-192.168.204.34@tcp:41:rm.0 Request processed in 181us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920450.217401:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:0.0:1790920450.223400:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920450.223526:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951190016 00000100:00100000:2.0:1790920450.223541:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951190016 00000100:00100000:2.0:1790920450.223620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:2.0:1790920450.223632:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:9687:x1877915951190016:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:2.0:1790920450.223669:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920450.223697:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa8c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.223841:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.223859:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.223873:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.223917:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.223925:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.223933:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224372:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a2c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224383:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224391:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920450.224439:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790920450.224445:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920450.224529:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224545:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224555:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224563:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224585:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224591:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920450.224596:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224605:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224620:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:2.0:1790920450.224623:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920450.224629:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224636:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224722:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224729:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224736:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224743:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920450.224903:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224923:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224932:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff88eb2cb2c600) 00010000:00010000:2.0:1790920450.224935:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920450.224938:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.224944:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.225000:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa8c expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.225017:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa8c expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.225025:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:2.0:1790920450.225028:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920450.225030:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b800, rc 0) 00000100:00100000:2.0:1790920450.225150:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:9687:x1877915951190016:12345-192.168.204.34@tcp:101:rm.0 Request processed in 1519us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920450.225160:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:0.0:1790920450.229040:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920450.229189:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951190272 00000100:00100000:3.0:1790920450.229204:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951190272 00000100:00100000:3.0:1790920450.229277:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:3.0:1790920450.229290:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:9687:x1877915951190272:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:3.0:1790920450.229371:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790920450.229409:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a2c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa8c expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229453:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b600/0x2a4915844546a274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa70 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229479:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:3.0:1790920450.229499:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa77 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229522:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:3.0:1790920450.229526:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920450.229557:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229573:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229585:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229605:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229612:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229620:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229832:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229842:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.229850:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790920450.230776:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1790920450.230797:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 292397048460ns, next at 293397044018ns, rc = 0 00010000:00010000:3.0:1790920450.230890:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.230904:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.230915:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.230925:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.230932:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.230940:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.230962:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920450.230994:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231001:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231008:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231015:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920450.231020:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231028:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231051:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:3.0:1790920450.231054:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790920450.231061:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231068:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a2dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231091:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231097:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231104:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231109:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920450.231112:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231118:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231125:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:3.0:1790920450.231128:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920450.231130:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920450.231135:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a2cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920450.231158:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004740b3c3 reply state 00000000a48390da transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920450.231169:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790920450.231291:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:9687:x1877915951190272:12345-192.168.204.34@tcp:36:rm.0 Request processed in 1999us (2262us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790920450.231301:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00010000:00010000:0.0:1790920450.231742:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920450.231783:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.231791:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37800 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920450.231795:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.231803:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.231815:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:0.0:1790920450.231818:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790920450.231821:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.231827:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a2e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920450.231845:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920450.231847:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920450.231849:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920450.234902:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.234925:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.234935:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.234943:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920450.234950:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.234958:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.234977:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff88eb04d19a00) 00010000:00010000:1.0:1790920450.234981:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920450.234987:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.235013:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a2d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920450.240518:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920450.241023:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951190528 00000100:00100000:1.0:1790920450.241037:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951190528 00000100:00100000:1.0:1790920450.241119:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1790920450.241132:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:9687:x1877915951190528:12345-192.168.204.34@tcp:35:rm.0 00000100:00100000:1.0:1790920450.241470:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:9687:x1877915951190528:12345-192.168.204.34@tcp:35:rm.0 Request processed in 338us (967us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790920450.241479:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1790920450.252994:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920450.253180:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951190784 00000100:00100000:2.0:1790920450.253197:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951190784 00000100:00100000:2.0:1790920450.253273:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:2.0:1790920450.253285:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:9687:x1877915951190784:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:2.0:1790920450.253369:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790920450.253424:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546a2a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa85 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253464:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546a243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa62 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253477:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:2.0:1790920450.253497:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa54 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253506:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920450.253513:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920450.253548:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253563:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253575:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253587:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253593:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.253598:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.255295:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.255339:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.255354:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920450.256216:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790920450.256240:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256249:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256257:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256264:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920450.256269:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256278:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256295:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88eb2cb2cc00) 00010000:00010000:2.0:1790920450.256298:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790920450.256304:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256310:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a2f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256340:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256356:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256362:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256368:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56aa00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920450.256371:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256377:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256385:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2c600) 00010000:00010000:2.0:1790920450.256388:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920450.256391:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920450.256397:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56aa00/0x2a4915844546a2eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920450.256412:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000216faf99 reply state 00000000a0b7b83d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920450.256423:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920450.256577:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:9687:x1877915951190784:12345-192.168.204.34@tcp:36:rm.0 Request processed in 3286us (3589us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790920450.256587:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00010000:00010000:1.0:1790920450.261499:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.261522:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.261531:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.261538:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920450.261543:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.261553:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.261574:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88eb2cb2c700) 00010000:00010000:1.0:1790920450.261577:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920450.261603:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920450.261611:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a800/0x2a4915844546a2f2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920451.113067:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920451.177149:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972196864:0@lo:400:kworker.0 00000100:00100000:1.0:1790920451.177250:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920451.177325:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920451.177333:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972196992:0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.177480:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972196736:0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.177522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920451.177545:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972197248:0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.177569:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920451.177594:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790920451.177600:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972196608:0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.177651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920451.177674:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972197120:0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.177694:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920451.177723:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196864 00000100:00100000:0.0:1790920451.177730:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196864 00000100:00100000:0.0:1790920451.178007:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196736 00000100:00100000:0.0:1790920451.178012:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196736 00000100:00100000:0.0:1790920451.178026:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972197120 00000100:00100000:0.0:1790920451.178029:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972197120 00000100:00100000:0.0:1790920451.178047:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790920451.178056:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972196864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.178107:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972196864:12345-0@lo:400:kworker.0 Request processed in 51us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920451.178114:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790920451.178131:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790920451.178137:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972196736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.178170:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972196736:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920451.178175:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790920451.178187:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790920451.178193:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972197120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920451.178222:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972197120:12345-0@lo:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920451.178228:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790920451.178260:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972197248 00000100:00100000:0.0:1790920451.178264:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972197248 00000100:00100000:0.0:1790920451.178307:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1790920451.179551:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920451.179558:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920451.179606:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972197120:0@lo:400:kworker.0 00000100:00100000:2.0:1790920451.179620:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972196736:0@lo:400:kworker.0 00000100:00100000:1.0:1790920451.182162:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920451.182552:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196608 00000100:00100000:1.0:1790920451.182562:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196608 00000100:00100000:1.0:1790920451.182617:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1790920451.182628:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972196608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920451.182709:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972196608:12345-0@lo:400:kworker.0 Request processed in 83us (5057us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920451.182717:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1790920451.182777:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972196992 00000100:00100000:1.0:1790920451.182781:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972196992 00000100:00100000:3.0:1790920451.183006:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972196608:0@lo:400:kworker.0 00000100:00080000:3.0:1790920451.183058:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920451.183079:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972197248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920451.183126:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972197248:12345-0@lo:400:kworker.0 Request processed in 3283us (5555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920451.183133:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1790920451.183165:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05635f80 x1877915972197248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920451.183178:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972197248:0@lo:400:kworker.0 00000100:00100000:1.0:1790920451.183665:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790920451.183676:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972196992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920451.183716:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972196992:12345-0@lo:400:kworker.0 Request processed in 44us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920451.183722:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1790920451.184528:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05634380 x1877915972196992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920451.184543:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972196992:0@lo:400:kworker.0 00000100:00100000:1.0:1790920451.184573:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972196864:0@lo:400:kworker.0 00000004:00080000:0.0:1790920451.689119:0:7078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 293855368663ns, next at 294855366406ns, rc = 0 00000100:00100000:1.0:1790920451.689216:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972197376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920451.689296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920451.689454:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972197376 00000100:00100000:2.0:1790920451.689462:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972197376 00000100:00100000:2.0:1790920451.689515:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790920451.689524:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972197376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920451.689545:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920451.689615:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972197376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920451.689622:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1790920451.689713:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb34439f80 x1877915972197376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920451.689733:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972197376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920451.734939:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920451.734986:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920451.735006:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920451.735041:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191040 00000100:00100000:2.0:1790920451.735051:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191040 00000100:00100000:2.0:1790920451.735109:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191296 00000100:00100000:2.0:1790920451.735113:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191296 00000100:00100000:2.0:1790920451.735147:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:2.0:1790920451.735156:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2354:x1877915951191040:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920451.735233:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2354:x1877915951191040:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920451.735241:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:2.0:1790920451.735257:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:2.0:1790920451.735264:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951191296:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920451.735306:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951191296:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 42us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920451.735325:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:2.0:1790920451.735366:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920451.736349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951190912 00000100:00100000:0.0:1790920451.736359:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951190912 00000100:00100000:0.0:1790920451.736412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 252 00000100:00100000:0.0:1790920451.736421:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951190912:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920451.736478:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951190912:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 58us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920451.736485:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 252 00000100:00080000:3.0:1790920451.737876:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920451.737896:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191168 00000100:00100000:3.0:1790920451.737904:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191168 00000100:00100000:3.0:1790920451.737954:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:3.0:1790920451.737975:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951191168:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920451.738050:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951191168:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 76us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920451.738057:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00010000:00010000:1.0:1790920452.137029:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920453.161032:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920453.228411:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920453.228624:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972197504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920453.228699:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920453.236665:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972197504 00000100:00100000:3.0:1790920453.236681:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972197504 00000100:00100000:3.0:1790920453.236835:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790920453.236846:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972197504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920453.236888:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920453.236972:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972197504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (8273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920453.236979:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1790920453.237147:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f655880 x1877915972197504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920453.237170:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972197504:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790920453.242972:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790920454.185015:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790920454.891962:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1790920455.214077:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790920455.370262:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1790920455.370294:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967300 is committed 00000001:00080000:2.0:1790920455.370307:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1790920455.370313:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1790920455.370347:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790920455.370709:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920455.370735:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972197632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790920455.370822:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920455.371305:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972197632 00000100:00100000:1.0:1790920455.371314:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972197632 00000100:00100000:1.0:1790920455.371400:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790920455.371410:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972197632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790920455.371436:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1790920455.371483:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abf4702, atime: 0x6abf4702, ctime: 0x6abf4702, blocks: 0x1 00010000:00010000:1.0:1790920455.371492:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.371509:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=297s v=(0 0) 00010000:00010000:1.0:1790920455.371513:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920455.371520:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.371536:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.371560:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.371568:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.371588:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1790920455.371791:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920455.372708:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972197632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1298us (1883us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790920455.372718:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790920455.372773:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920455.372781:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.372793:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139ca00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920455.372797:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.372807:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.372826:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.372834:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb81d77f/0x2a4915844546a300 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920455.372862:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920455.372864:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920455.372866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790920455.373099:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb41f73b80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1790920455.373108:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972197632:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1790920456.234236:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920456.303338:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920456.303452:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920456.303472:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972198144:0@lo:400:kworker.0 00000100:00100000:0.0:1790920456.303544:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920456.303620:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972198144 00000100:00100000:0.0:1790920456.303627:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972198144 00000100:00100000:0.0:1790920456.303686:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790920456.303696:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972198144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920456.303781:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972198144:12345-0@lo:400:kworker.0 Request processed in 86us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.303790:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790920456.303842:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972198144:0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.309366:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972197760:0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.309448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920456.309525:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972197888:0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.309560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920456.309590:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920456.309598:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972198016:0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.309623:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920456.309876:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972197760 00000100:00100000:0.0:1790920456.309892:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972197760 00000100:00100000:0.0:1790920456.309942:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790920456.309952:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972197760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920456.310943:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972197760:12345-0@lo:400:kworker.0 Request processed in 988us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.310953:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790920456.311835:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972197888 00000100:00100000:0.0:1790920456.311843:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972197888 00000100:00100000:0.0:1790920456.311897:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972198016 00000100:00100000:0.0:1790920456.311901:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972198016 00000100:00100000:0.0:1790920456.311942:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790920456.311951:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972197888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920456.312013:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972197888:12345-0@lo:400:kworker.0 Request processed in 64us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.312020:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790920456.312034:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790920456.312041:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972198016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920456.312070:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972198016:12345-0@lo:400:kworker.0 Request processed in 30us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.312076:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1790920456.312091:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920456.313814:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972198272:0@lo:400:kworker.0 00000100:00100000:3.0:1790920456.313870:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920456.313915:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972198272 00000100:00100000:3.0:1790920456.313921:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972198272 00000100:00100000:3.0:1790920456.313962:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790920456.313968:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972198272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920456.314008:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972198272:12345-0@lo:400:kworker.0 Request processed in 40us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920456.314014:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1790920456.314031:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920456.314055:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972198272:0@lo:400:kworker.0 00000100:00100000:3.0:1790920456.314097:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790920456.314106:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972198400:0@lo:400:kworker.0 00000100:00100000:3.0:1790920456.314135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920456.314829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972197760:0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.314862:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972198016:0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.314874:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972197888:0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.314894:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972198400 00000100:00100000:1.0:1790920456.314897:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972198400 00000100:00100000:1.0:1790920456.314938:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790920456.314945:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972198400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920456.314991:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972198400:12345-0@lo:400:kworker.0 Request processed in 46us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920456.314998:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1790920456.315444:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3a92fb80 x1877915972198400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920456.315456:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972198400:0@lo:400:kworker.0 00000100:00080000:3.0:1790920456.315473:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1790920456.433377:0:11676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd551b6420 20000000:00000080:0.0:1790920456.433395:0:11676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88eb3fe7d400 uarg=0000000000000000 20000000:01000000:0.0:1790920456.433434:0:11676:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790920456.433440:0:11676:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790920456.433725:0:11676:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1790920456.435379:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1790920456.435706:0:11676:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1790920456.443635:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1790920456.443692:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1790920456.443815:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1790920456.443833:0:11676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790920456.443852:0:11676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.443872:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.443881:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.443890:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.443898:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a1be expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.443903:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a1cc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.443910:0:11676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.444270:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a1cc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.444288:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a1cc expref: 18 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920456.444302:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198528:0@lo:104: 00000100:00100000:1.0:1790920456.444375:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790920456.444807:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a1be expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.444817:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a1be expref: 18 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920456.444826:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198656:0@lo:104: 00000100:00100000:1.0:1790920456.444851:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790920456.444883:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.444891:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 18 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920456.444899:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198784:0@lo:104: 00000100:00100000:1.0:1790920456.444937:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920456.445066:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790920456.445086:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972198528 00000100:00100000:0.0:1790920456.445094:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972198528 00000100:00100000:0.0:1790920456.445130:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972198656 00000100:00100000:0.0:1790920456.445133:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972198656 00000100:00100000:0.0:1790920456.445144:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972198784 00000100:00100000:0.0:1790920456.445146:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972198784 00000100:00100000:0.0:1790920456.445159:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790920456.445167:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:11676:x1877915972198528:12345-0@lo:104: 00010000:00010000:0.0:1790920456.445181:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445231:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790920456.445237:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+5:11676:x1877915972198528:12345-0@lo:104: Request processed in 71us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.445244:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790920456.445262:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790920456.445267:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:11676:x1877915972198656:12345-0@lo:104: 00010000:00010000:0.0:1790920456.445275:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445321:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790920456.445326:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+4:11676:x1877915972198656:12345-0@lo:104: Request processed in 60us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.445332:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790920456.445345:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790920456.445350:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3aa58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:11676:x1877915972198784:12345-0@lo:104: 00010000:00010000:0.0:1790920456.445358:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445398:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790920456.445403:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3aa58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+3:11676:x1877915972198784:12345-0@lo:104: Request processed in 54us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.445409:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1790920456.445458:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790920456.445464:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445472:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920456.445477:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445486:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920456.445493:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920456.445500:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790920456.445528:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445536:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920456.445563:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445571:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a1cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445609:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920456.445612:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445618:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920456.445621:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445628:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920456.445635:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920456.445640:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790920456.445656:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445661:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920456.445677:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445684:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb3f56be00/0x2a4915844546a1be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445693:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920456.445695:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445712:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031c00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920456.445715:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445721:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920456.445728:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920456.445734:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790920456.445767:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445774:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920456.445781:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445788:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00031c00/0x2a4915844546a1b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546a1b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.445802:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920456.445804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920456.445806:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920456.445822:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920456.445834:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972199040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920456.445865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920456.445890:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972199168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920456.445923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920456.445943:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920456.445948:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb070e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972199296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790920456.446213:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.446229:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 12 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920456.446240:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198912:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920456.446302:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920456.446326:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920456.446335:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972199424:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920456.446367:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2600 going to sleep for 11 seconds 00000100:00100000:1.0:1790920456.446386:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198528:0@lo:104: 00000100:00100000:1.0:1790920456.446395:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198656:0@lo:104: 00000100:00100000:1.0:1790920456.446402:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198784:0@lo:104: 00000100:00100000:0.0:1790920456.448081:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920456.448139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972199040 00000100:00100000:0.0:1790920456.448147:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972199040 00010000:00010000:0.0:1790920456.448178:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a1cc expref: 19 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920456.448207:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972199168 00000100:00100000:0.0:1790920456.448210:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972199168 00010000:00010000:0.0:1790920456.448222:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a1be expref: 20 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920456.448231:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972199296 00000100:00100000:0.0:1790920456.448233:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972199296 00010000:00010000:0.0:1790920456.448242:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 21 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920456.448253:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790920456.448261:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+21:3304:x1877915972199040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920456.448273:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920456.448278:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a1cc expref: 21 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448290:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a1cc expref: 21 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448305:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029ef400/0x2a4915844546a1d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a1cc expref: 21 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448350:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920456.448386:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+20:3304:x1877915972199040:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.448393:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790920456.448411:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790920456.448417:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972199168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920456.448425:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920456.448429:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a1be expref: 19 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448438:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a1be expref: 19 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448447:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029efe00/0x2a4915844546a1c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a1be expref: 19 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448455:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920456.448480:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:3306:x1877915972199168:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.448486:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790920456.448497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790920456.448502:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:3306:x1877915972199296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920456.448509:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920456.448514:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 17 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448523:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 17 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448538:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56a400/0x2a4915844546a1b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546a1b0 expref: 17 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.448545:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920456.448567:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3306:x1877915972199296:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.448572:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790920456.449564:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972199040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790920456.449812:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920456.450040:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972199296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920456.450053:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb070e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972199168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920456.469502:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972198912:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920456.478649:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1877915972199424:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920456.478695:0:11676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920456.484325:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920456.484377:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920456.484573:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191424 00000100:00100000:0.0:1790920456.484594:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191424 00010000:00010000:0.0:1790920456.484637:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 13 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920456.484674:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191552 00000100:00100000:0.0:1790920456.484677:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191552 00010000:00010000:0.0:1790920456.484689:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 14 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920456.484717:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:0.0:1790920456.484726:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+14:2355:x1877915951191424:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920456.484778:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920456.484784:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 14 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.484797:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 14 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.484813:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb41e36000/0x2a4915844546a1a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa46 expref: 14 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.484827:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920456.484891:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951191424:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 166us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.484898:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:0.0:1790920456.484913:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:0.0:1790920456.484920:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:2355:x1877915951191552:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920456.484927:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920456.484931:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.484938:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.484947:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56bc00/0x2a4915844546a1a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa3f expref: 12 pid: 5837 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.484970:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.484987:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485002:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485009:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485015:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485021:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485027:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139ca00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920456.485031:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485039:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485053:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485063:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920456.485083:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:2355:x1877915951191552:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 164us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.485090:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00010000:00010000:0.0:1790920456.485280:0:11676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485294:0:11676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920456.485300:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a307 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920456.815030:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790920456.815051:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972199552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920456.815122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920456.815187:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972199552 00000100:00100000:2.0:1790920456.815194:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972199552 00000100:00100000:2.0:1790920456.815250:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790920456.815260:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972199552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920456.815297:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920456.815536:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972199552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 275us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920456.815543:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790920456.815602:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972199552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920456.844139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920456.844184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920456.844220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920456.844349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191680 00000100:00100000:3.0:1790920456.844359:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191680 00000100:00100000:3.0:1790920456.844419:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191936 00000100:00100000:3.0:1790920456.844422:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191936 00000100:00100000:3.0:1790920456.844438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:3.0:1790920456.844447:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951191680:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920456.844517:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951191680:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 70us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920456.844524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:3.0:1790920456.844541:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:3.0:1790920456.844547:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951191936:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920456.844572:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2354:x1877915951191936:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920456.844579:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00080000:2.0:1790920456.844684:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920456.845961:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951191808 00000100:00100000:0.0:1790920456.845970:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951191808 00000100:00100000:0.0:1790920456.846033:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:0.0:1790920456.846042:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951191808:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:2.0:1790920456.846157:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920456.846235:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951191808:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 194us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920456.846244:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00010000:00010000:0.0:1790920457.258704:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790920457.576919:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790920457.576927:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3a4ce000 from 7 10000000:01000000:0.0:1790920457.576932:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920457.576983:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920457.576995:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920457.577007:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920457.577034:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972199680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790920457.577115:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920457.577203:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8840 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.577474:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972199680 00000100:00100000:1.0:1790920457.577483:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972199680 00000100:00100000:1.0:1790920457.577537:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790920457.577547:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:5842:x1877915972199680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920457.577571:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920457.577595:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb0139c800/0x2a4915844546a315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a30e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920457.577621:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139c800/0x2a4915844546a315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a30e expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920457.577632:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb0139c800/0x2a4915844546a315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a30e expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920457.577641:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139c800, rc 0) 00000100:00100000:1.0:1790920457.577693:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972199680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.577699:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790920457.578094:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972199680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920457.578111:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920457.578120:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920457.578176:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972199808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920457.578206:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920457.578240:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a180 going to sleep for 11 seconds 00000100:00100000:0.0:1790920457.578400:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972199808 00000100:00100000:0.0:1790920457.578405:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972199808 00000100:00100000:0.0:1790920457.578439:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790920457.578446:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972199808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920457.578697:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972199808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920457.578713:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790920457.578853:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972199808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.578888:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972199936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.578937:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.578975:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5600 going to sleep for 11 seconds 00000100:00100000:0.0:1790920457.579031:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972199936 00000100:00100000:0.0:1790920457.579036:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972199936 00000100:00100000:0.0:1790920457.579053:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790920457.579058:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972199936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920457.580576:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972199936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1513us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920457.580587:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790920457.581857:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972199936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920457.582396:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11689:1877915972200064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920457.582470:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920457.582516:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.582637:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200064 00000100:00100000:1.0:1790920457.582644:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200064 00000100:00100000:1.0:1790920457.582690:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790920457.582699:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:11689:x1877915972200064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920457.582961:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:11689:x1877915972200064:12345-0@lo:502:llog_process_th.0 Request processed in 262us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.582967:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790920457.583771:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11689:1877915972200064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790920457.583803:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920457.583812:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920457.583815:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790920457.583821:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88eb3a4ce000 00000020:00000080:0.0:1790920457.583823:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790920457.583922:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11689:1877915972200192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920457.583979:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920457.584022:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.586009:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200192 00000100:00100000:1.0:1790920457.586020:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200192 00000100:00100000:1.0:1790920457.586073:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790920457.586080:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:11689:x1877915972200192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920457.587339:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:11689:x1877915972200192:12345-0@lo:502:llog_process_th.0 Request processed in 1255us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.587350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790920457.598768:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11689:1877915972200192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790920457.598834:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920457.598843:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920457.598846:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790920457.598851:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790920457.599428:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790920457.599451:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790920457.599459:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920457.599470:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920457.599480:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790920457.599483:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb05888000 from 7 10000000:01000000:3.0:1790920457.599485:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790920457.599517:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920457.599524:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920457.599532:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920457.599550:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.599618:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.599660:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5600 going to sleep for 11 seconds 00000100:00100000:2.0:1790920457.599909:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200320 00000100:00100000:2.0:1790920457.599916:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200320 00000100:00100000:2.0:1790920457.600164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790920457.600174:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:5842:x1877915972200320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920457.600188:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920457.600201:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a323 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a31c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920457.600235:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a31c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920457.600246:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a31c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920457.600266:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56aa00, rc 0) 00000100:00100000:2.0:1790920457.600436:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972200320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920457.600442:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790920457.601418:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920457.601639:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920457.601657:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920457.601724:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.601780:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.601809:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5600 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.602177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200448 00000100:00100000:1.0:1790920457.602185:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200448 00000100:00100000:1.0:1790920457.602627:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790920457.602637:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972200448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920457.604835:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972200448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2193us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.604847:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790920457.607922:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.607999:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.608067:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.610107:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5600 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.612332:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200576 00000100:00100000:1.0:1790920457.612344:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200576 00000100:00100000:1.0:1790920457.612400:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790920457.612409:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972200576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920457.612650:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972200576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (4583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.612658:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790920457.614258:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.616791:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11691:1877915972200704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920457.616874:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.616912:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.617464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200704 00000100:00100000:1.0:1790920457.617473:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200704 00000100:00100000:1.0:1790920457.617533:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790920457.617541:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:11691:x1877915972200704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920457.617819:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:11691:x1877915972200704:12345-0@lo:502:llog_process_th.0 Request processed in 278us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.617828:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790920457.619456:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11691:1877915972200704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790920457.619503:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790920457.619514:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920457.619516:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790920457.619523:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88eb05888000 00000020:00000080:3.0:1790920457.619526:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790920457.619629:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11691:1877915972200832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920457.619694:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.619726:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.621530:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200832 00000100:00100000:1.0:1790920457.621544:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200832 00000100:00100000:1.0:1790920457.621602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790920457.621611:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:11691:x1877915972200832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920457.621878:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:11691:x1877915972200832:12345-0@lo:502:llog_process_th.0 Request processed in 267us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.621885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790920457.622733:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11691:1877915972200832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790920457.622818:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920457.622825:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920457.622828:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790920457.622833:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790920457.624865:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790920457.624907:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790920457.624919:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920457.624932:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920457.624944:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790920457.624947:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb09ba1000 from 7 10000000:01000000:1.0:1790920457.624963:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790920457.625002:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920457.625009:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920457.625035:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920457.625059:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790920457.625460:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920457.625511:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2600 going to sleep for 11 seconds 00000100:00100000:2.0:1790920457.625623:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972200960 00000100:00100000:2.0:1790920457.625633:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972200960 00000100:00100000:2.0:1790920457.625684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790920457.625692:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:5842:x1877915972200960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920457.625706:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920457.625719:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56a800/0x2a4915844546a331 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546a32a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920457.625742:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56a800/0x2a4915844546a331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546a32a expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920457.625772:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56a800/0x2a4915844546a331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546a32a expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920457.625781:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a800, rc 0) 00000100:00100000:2.0:1790920457.625827:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972200960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920457.625833:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790920457.626396:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972200960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920457.626411:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920457.626429:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920457.626482:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972201088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.626510:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.626538:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920457.626618:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201088 00000100:00100000:2.0:1790920457.626623:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201088 00000100:00100000:2.0:1790920457.626643:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790920457.626648:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972201088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920457.626884:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972201088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920457.626906:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790920457.627527:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972201088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.627558:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972201216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920457.627597:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920457.627615:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.627872:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201216 00000100:00100000:1.0:1790920457.627878:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201216 00000100:00100000:1.0:1790920457.627918:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790920457.627926:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972201216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920457.629612:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:5842:x1877915972201216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1682us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.629623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790920457.629769:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:5842:1877915972201216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920457.638531:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11693:1877915972201344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920457.638617:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920457.638651:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920457.639087:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201344 00000100:00100000:1.0:1790920457.639094:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201344 00000100:00100000:1.0:1790920457.639147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790920457.639156:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:11693:x1877915972201344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920457.639397:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:11693:x1877915972201344:12345-0@lo:502:llog_process_th.0 Request processed in 242us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920457.639404:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790920457.639540:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11693:1877915972201344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790920457.639569:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920457.639578:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920457.639580:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790920457.639588:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88eb09ba1000 00000020:00000080:0.0:1790920457.639590:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790920457.639670:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11693:1877915972201472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920457.639704:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920457.639723:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920457.639843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201472 00000100:00100000:3.0:1790920457.639848:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201472 00000100:00100000:3.0:1790920457.639877:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790920457.639884:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:11693:x1877915972201472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920457.640014:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:11693:x1877915972201472:12345-0@lo:502:llog_process_th.0 Request processed in 130us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920457.640028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790920457.640060:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:11693:1877915972201472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790920457.640076:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790920457.640080:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790920457.640081:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790920457.640086:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790920457.640137:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790920457.640155:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790920457.640163:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920457.640174:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920457.663737:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790920458.068544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920458.070596:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192064 00000100:00100000:3.0:1790920458.070610:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192064 00000100:00100000:2.0:1790920458.075485:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 269 00000100:00100000:2.0:1790920458.075501:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:5595:x1877915951192064:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920458.075518:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920458.075537:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56b600/0x2a4915844546a338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa93 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920458.075576:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56b600/0x2a4915844546a338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa93 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920458.075587:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56b600/0x2a4915844546a338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa93 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920458.075596:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b600, rc 0) 00000100:00100000:2.0:1790920458.075671:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951192064:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 174us (7137us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920458.075679:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 269 00000100:00100000:3.0:1790920458.080744:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920458.096234:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192192 00000100:00100000:0.0:1790920458.096250:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192192 00000100:00100000:0.0:1790920458.096319:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 270 00000100:00100000:0.0:1790920458.096330:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951192192:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920458.097035:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951192192:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 706us (16297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920458.097043:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 270 00000100:00100000:3.0:1790920458.112250:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920458.113392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192320 00000100:00100000:0.0:1790920458.113404:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192320 00000100:00100000:0.0:1790920458.113673:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 271 00000100:00100000:0.0:1790920458.113684:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951192320:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920458.114252:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951192320:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 568us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920458.114268:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 271 00000100:00100000:3.0:1790920458.124719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920458.126202:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192448 00000100:00100000:1.0:1790920458.126213:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192448 00000100:00100000:1.0:1790920458.126273:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 272 00000100:00100000:1.0:1790920458.126293:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:9959:x1877915951192448:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790920458.126533:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:9959:x1877915951192448:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 242us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920458.126547:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 272 00000100:00100000:3.0:1790920458.132821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920458.132964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192576 00000100:00100000:2.0:1790920458.132974:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192576 00000100:00100000:2.0:1790920458.133017:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 273 00000100:00100000:2.0:1790920458.133025:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:9959:x1877915951192576:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790920458.133510:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:9959:x1877915951192576:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 482us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920458.133519:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 273 00000100:00100000:3.0:1790920458.149524:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920458.150489:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192704 00000100:00100000:1.0:1790920458.150502:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192704 00000100:00100000:1.0:1790920458.150624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 274 00000100:00100000:1.0:1790920458.150634:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:5595:x1877915951192704:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920458.150650:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920458.150669:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a33f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaa9a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920458.150695:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa9a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920458.150720:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa9a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920458.150729:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139ca00, rc 0) 00000100:00100000:1.0:1790920458.150834:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951192704:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 194us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920458.150842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 274 00000100:00100000:3.0:1790920458.153935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920458.154095:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192832 00000100:00100000:2.0:1790920458.154117:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192832 00000100:00100000:2.0:1790920458.154164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 275 00000100:00100000:2.0:1790920458.154173:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951192832:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920458.154446:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951192832:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 273us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920458.154462:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 275 00000100:00100000:3.0:1790920458.158093:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920458.158225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951192960 00000100:00100000:0.0:1790920458.158235:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951192960 00000100:00100000:0.0:1790920458.158293:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 276 00000100:00100000:0.0:1790920458.158309:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951192960:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920458.158516:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:5595:x1877915951192960:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 214us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920458.158523:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 276 00000100:00100000:3.0:1790920458.161521:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920458.161707:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193088 00000100:00100000:1.0:1790920458.161716:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193088 00000100:00100000:1.0:1790920458.161779:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 277 00000100:00100000:1.0:1790920458.161789:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:9962:x1877915951193088:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790920458.162120:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:9962:x1877915951193088:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 332us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920458.162128:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 277 00000100:00100000:3.0:1790920458.169831:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920458.178006:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193216 00000100:00100000:2.0:1790920458.178019:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193216 00000100:00100000:2.0:1790920458.178089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 278 00000100:00100000:2.0:1790920458.178099:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:9962:x1877915951193216:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790920458.178367:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:9962:x1877915951193216:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 269us (8545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920458.178376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 278 00010000:00010000:3.0:1790920458.281115:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920458.345763:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920458.345786:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972201600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920458.345859:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920458.346160:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201600 00000100:00100000:2.0:1790920458.346168:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201600 00000100:00100000:2.0:1790920458.346228:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790920458.346237:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972201600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920458.346280:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920458.346325:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972201600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920458.346333:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1790920458.346453:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f654380 x1877915972201600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920458.346471:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972201600:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790920458.346763:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1790920458.668244:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790920459.306959:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920460.329567:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790920460.500821:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1790920461.355468:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920461.417707:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972201984:0@lo:400:kworker.0 00000100:00100000:0.0:1790920461.417807:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920461.418037:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972201728:0@lo:400:kworker.0 00000100:00100000:1.0:1790920461.418083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920461.418124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201728 00000100:00100000:1.0:1790920461.418132:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201728 00000100:00100000:1.0:1790920461.418179:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790920461.418187:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972201728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920461.418263:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972201728:12345-0@lo:400:kworker.0 Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920461.418270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790920461.418323:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972202112:0@lo:400:kworker.0 00000100:00100000:1.0:1790920461.418350:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920461.418374:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972202112 00000100:00100000:1.0:1790920461.418378:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972202112 00000100:00100000:1.0:1790920461.418415:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790920461.418422:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972202112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920461.418456:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972202112:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920461.418462:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790920461.418718:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972201856:0@lo:400:kworker.0 00000100:00100000:3.0:1790920461.418766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920461.418902:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201984 00000100:00100000:1.0:1790920461.418906:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201984 00000100:00100000:3.0:1790920461.427454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972201856 00000100:00100000:3.0:1790920461.427471:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972201856 00000100:00100000:0.0:1790920461.427637:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972201728:0@lo:400:kworker.0 00000100:00100000:0.0:1790920461.427651:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972202240:0@lo:400:kworker.0 00000100:00100000:0.0:1790920461.427729:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920461.427817:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972202240 00000100:00100000:0.0:1790920461.427821:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972202240 00000100:00100000:1.0:1790920461.437403:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790920461.437428:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972201984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920461.437536:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972201984:12345-0@lo:400:kworker.0 Request processed in 121us (19729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920461.437558:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790920461.443020:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790920461.443046:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972201856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920461.443158:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972201856:12345-0@lo:400:kworker.0 Request processed in 123us (24390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920461.443165:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1790920461.443196:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790920461.443203:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920461.443256:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972201856:0@lo:400:kworker.0 00000100:00100000:3.0:1790920461.443267:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972202368:0@lo:400:kworker.0 00000100:00100000:3.0:1790920461.443303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920461.443459:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972202368 00000100:00100000:3.0:1790920461.443466:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972202368 00000100:00100000:3.0:1790920461.443511:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790920461.443518:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972202368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920461.443554:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972202368:12345-0@lo:400:kworker.0 Request processed in 36us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920461.443560:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1790920461.443575:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920461.443594:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1790920461.443600:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb41f73b80, transno 4294967300 00000100:00100000:3.0:1790920461.443624:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972202112:0@lo:400:kworker.0 00010000:00080000:3.0:1790920461.443652:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb41d30a80 x1877915972202368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920461.443662:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972202368:0@lo:400:kworker.0 00000100:00100000:3.0:1790920461.443684:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972201984:0@lo:400:kworker.0 00000100:00100000:0.0:1790920461.443846:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790920461.443856:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972202240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920461.443897:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972202240:12345-0@lo:400:kworker.0 Request processed in 44us (16168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920461.443903:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790920461.443944:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972202240:0@lo:400:kworker.0 00000100:00100000:1.0:1790920461.930582:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790920461.930607:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972202496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920461.930676:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920461.930995:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972202496 00000100:00100000:2.0:1790920461.931003:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972202496 00000100:00100000:2.0:1790920461.931062:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790920461.931071:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972202496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920461.931116:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920461.931188:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972202496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920461.931195:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790920461.931515:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972202496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920461.965605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920461.965648:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920461.965674:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920461.965690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193344 00000100:00100000:0.0:1790920461.965700:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193344 00000100:00100000:3.0:1790920461.965712:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920461.965771:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193472 00000100:00100000:3.0:1790920461.965776:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193472 00000100:00100000:0.0:1790920461.965785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 280 00000100:00100000:0.0:1790920461.965795:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951193344:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:3.0:1790920461.965797:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920461.965837:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193728 00000100:00100000:3.0:1790920461.965839:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193728 00000100:00080000:3.0:1790920461.965851:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920461.965868:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951193344:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920461.965875:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 280 00000100:00100000:0.0:1790920461.965912:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:0.0:1790920461.965919:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951193472:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920461.965938:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790920461.965945:0:5845:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790920461.965957:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951193472:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920461.965963:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:0.0:1790920461.965978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:0.0:1790920461.965985:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951193728:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920461.966010:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951193728:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920461.966015:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:1.0:1790920461.969139:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193600 00000100:00100000:1.0:1790920461.969153:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193600 00000100:00100000:1.0:1790920461.969251:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:1.0:1790920461.969262:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951193600:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:3.0:1790920461.969309:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920461.969348:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951193600:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 79us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920461.969356:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 66 00010000:00010000:3.0:1790920462.377088:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920463.402616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920463.465284:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920463.465311:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972202624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920463.465506:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920463.465644:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972202624 00000100:00100000:0.0:1790920463.465654:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972202624 00000100:00100000:0.0:1790920463.465734:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790920463.465764:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972202624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790920463.465818:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920463.465873:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972202624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920463.465896:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1790920463.466201:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790920463.466231:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f654000 x1877915972202624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920463.466372:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972202624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790920464.425202:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920465.449194:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920466.476013:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920466.538827:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972203136:0@lo:400:kworker.0 00000100:00100000:2.0:1790920466.538903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920466.538967:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790920466.538974:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972203008:0@lo:400:kworker.0 00000100:00100000:2.0:1790920466.539003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920466.539096:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972202752:0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920466.539179:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972203264:0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920466.539221:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790920466.539228:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972202880:0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539251:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920466.539265:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972203392:0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539284:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920466.539312:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203008 00000100:00100000:0.0:1790920466.539320:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203008 00000100:00100000:0.0:1790920466.539366:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203264 00000100:00100000:0.0:1790920466.539370:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203264 00000100:00100000:0.0:1790920466.539383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972202880 00000100:00100000:0.0:1790920466.539385:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972202880 00000100:00100000:0.0:1790920466.539399:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790920466.539407:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972203008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539472:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972203008:12345-0@lo:400:kworker.0 Request processed in 64us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920466.539479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790920466.539496:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790920466.539502:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972203264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539546:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972203264:12345-0@lo:400:kworker.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920466.539571:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790920466.539584:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790920466.539591:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972202880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539619:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972202880:12345-0@lo:400:kworker.0 Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920466.539624:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790920466.539665:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972202880:0@lo:400:kworker.0 00000100:00100000:0.0:1790920466.539674:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972203264:0@lo:400:kworker.0 00000100:00100000:2.0:1790920466.539981:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972202752 00000100:00100000:2.0:1790920466.539986:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972202752 00000100:00100000:2.0:1790920466.540023:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790920466.540030:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972202752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920466.540072:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972202752:12345-0@lo:400:kworker.0 Request processed in 41us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920466.540079:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790920466.540130:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972203008:0@lo:400:kworker.0 00000100:00100000:2.0:1790920466.540154:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972202752:0@lo:400:kworker.0 00000100:00100000:3.0:1790920466.540339:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203136 00000100:00100000:3.0:1790920466.540344:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203136 00000100:00100000:3.0:1790920466.540380:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203392 00000100:00100000:3.0:1790920466.540383:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203392 00000100:00100000:3.0:1790920466.540409:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920466.540416:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972203136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920466.540471:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972203136:12345-0@lo:400:kworker.0 Request processed in 56us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920466.540477:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920466.540492:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790920466.540498:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972203392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920466.540543:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972203392:12345-0@lo:400:kworker.0 Request processed in 45us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920466.540549:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1790920466.540571:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790920466.540574:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790920466.540576:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920466.540594:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972203136:0@lo:400:kworker.0 00010000:00080000:3.0:1790920466.540617:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f654380 x1877915972203392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920466.540626:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972203392:0@lo:400:kworker.0 00000100:00100000:2.0:1790920467.053908:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972203520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920467.053979:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920467.054390:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203520 00000100:00100000:1.0:1790920467.054399:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203520 00000100:00100000:1.0:1790920467.054445:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790920467.054468:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972203520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790920467.054511:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920467.054581:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972203520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920467.054588:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790920467.059122:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972203520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920467.085574:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920467.085620:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920467.085659:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920467.085721:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920467.085780:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951194112 00000100:00100000:3.0:1790920467.085790:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951194112 00000100:00100000:3.0:1790920467.085854:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:3.0:1790920467.085865:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951194112:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920467.086023:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193984 00000100:00100000:0.0:1790920467.086028:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193984 00000100:00100000:0.0:1790920467.086061:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951194240 00000100:00100000:0.0:1790920467.086063:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951194240 00000100:00100000:0.0:1790920467.086083:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:0.0:1790920467.086090:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951193984:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920467.086162:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951194112:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 299us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920467.086170:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00080000:3.0:1790920467.086191:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790920467.086196:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920467.086256:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 124 00000100:00100000:1.0:1790920467.086267:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951194240:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920467.095034:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951193984:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 8932us (9456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920467.095049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:0.0:1790920467.095091:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951193856 00000100:00100000:0.0:1790920467.095099:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951193856 00000100:00100000:0.0:1790920467.095153:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 282 00000100:00100000:0.0:1790920467.095162:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951193856:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920467.095240:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951193856:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 78us (9578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920467.095246:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 282 00000100:00100000:1.0:1790920467.109982:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951194240:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 23705us (24356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920467.110017:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 124 00010000:00010000:0.0:1790920467.497737:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920468.522965:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920468.585361:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920468.585385:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972203648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920468.585455:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920468.585711:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203648 00000100:00100000:2.0:1790920468.585720:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203648 00000100:00100000:2.0:1790920468.585822:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790920468.585833:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972203648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920468.585871:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920468.585921:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972203648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920468.585944:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1790920468.586119:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790920468.586151:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05634380 x1877915972203648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920468.586170:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972203648:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790920468.905497:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790920469.544959:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920470.569005:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920471.593261:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920471.656989:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972204032:0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.657058:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972203776:0@lo:400:kworker.0 00000100:00100000:0.0:1790920471.657085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920471.657098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920471.657161:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204032 00000100:00100000:2.0:1790920471.657173:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204032 00000100:00100000:0.0:1790920471.657177:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920471.657183:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972204160:0@lo:400:kworker.0 00000100:00100000:2.0:1790920471.657242:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790920471.657254:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972204032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920471.657274:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972203904:0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.664544:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972204288:0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.664628:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920471.664759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203776 00000100:00100000:1.0:1790920471.664768:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203776 00000100:00100000:1.0:1790920471.664814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1790920471.664823:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972203776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.664877:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972203776:12345-0@lo:400:kworker.0 Request processed in 53us (7777us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920471.664884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1790920471.665186:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972203776:0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.665215:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204288 00000100:00100000:1.0:1790920471.665218:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204288 00000100:00100000:1.0:1790920471.665247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790920471.665253:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972204288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.665285:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972204288:12345-0@lo:400:kworker.0 Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920471.665291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790920471.665315:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972204288:0@lo:400:kworker.0 00000100:00080000:1.0:1790920471.665498:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920471.672688:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920471.674865:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204160 00000100:00100000:1.0:1790920471.674880:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204160 00000100:00100000:1.0:1790920471.674969:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790920471.674979:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972204160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.675076:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972204160:12345-0@lo:400:kworker.0 Request processed in 99us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920471.675083:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1790920471.675106:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920471.675945:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972204160:0@lo:400:kworker.0 00000100:00100000:2.0:1790920471.679396:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972204032:12345-0@lo:400:kworker.0 Request processed in 22136us (22302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920471.679413:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790920471.679607:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972204032:0@lo:400:kworker.0 00000100:00100000:3.0:1790920471.686940:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920471.687027:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972204416:0@lo:400:kworker.0 00000100:00100000:3.0:1790920471.687070:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920471.687426:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204416 00000100:00100000:0.0:1790920471.687435:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204416 00000100:00100000:0.0:1790920471.687518:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790920471.687529:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972204416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920471.687588:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972204416:12345-0@lo:400:kworker.0 Request processed in 61us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920471.687666:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790920471.687786:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972203904 00000100:00100000:1.0:1790920471.687792:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972203904 00000100:00100000:1.0:1790920471.687825:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790920471.687832:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972203904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920471.687872:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972203904:12345-0@lo:400:kworker.0 Request processed in 42us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920471.687877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1790920471.687956:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920471.688049:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972203904:0@lo:400:kworker.0 00010000:00080000:3.0:1790920471.688062:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05635180 x1877915972204416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920471.688073:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972204416:0@lo:400:kworker.0 00000100:00100000:0.0:1790920472.170396:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972204544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920472.170492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920472.170779:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204544 00000100:00100000:2.0:1790920472.170789:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204544 00000100:00100000:2.0:1790920472.170849:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790920472.170858:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972204544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920472.170894:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920472.170947:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972204544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920472.170954:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790920472.171271:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972204544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920472.212350:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920472.212630:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951194368 00000100:00100000:0.0:1790920472.212648:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951194368 00000100:00100000:0.0:1790920472.212729:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 284 00000100:00100000:0.0:1790920472.212739:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951194368:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920472.212900:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920472.213229:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951194496 00000100:00100000:1.0:1790920472.213236:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951194496 00000100:00100000:1.0:1790920472.213299:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:1.0:1790920472.213308:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951194496:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:2.0:1790920472.213368:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920472.215621:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951194368:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 2872us (3275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920472.215635:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 284 00000100:00100000:1.0:1790920472.230278:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951194496:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 16957us (17367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920472.230294:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:2.0:1790920472.245381:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920472.245452:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920472.245563:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951194752 00000100:00100000:0.0:1790920472.245577:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951194752 00000100:00100000:0.0:1790920472.245686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 129 00000100:00100000:0.0:1790920472.245697:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951194752:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920472.245819:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951194752:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 123us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920472.245827:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 129 00000100:00080000:2.0:1790920472.245919:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920472.246133:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951194624 00000100:00100000:1.0:1790920472.246143:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951194624 00000100:00100000:1.0:1790920472.246228:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:1.0:1790920472.246239:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2351:x1877915951194624:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:1.0:1790920472.246274:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a27b 00000100:00080000:1.0:1790920472.246287:0:6688:0:(import.c:65:import_set_state_nolock()) ffff88eb07066000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790920472.246342:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1790920472.246400:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790920472.247044:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920472.247874:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+2:2351:x1877915951194624:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 1627us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920472.247889:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00010000:00010000:0.0:1790920472.620595:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920473.641222:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920473.705484:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920473.705510:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972204672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920473.705583:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920473.705718:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204672 00000100:00100000:2.0:1790920473.705728:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204672 00000100:00100000:2.0:1790920473.705824:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790920473.705835:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972204672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920473.705875:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920473.705939:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972204672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920473.705946:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1790920473.706039:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05635500 x1877915972204672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920473.706057:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972204672:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790920473.706182:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790920474.665138:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920475.689202:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790920475.875857:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:0.0:1790920475.875882:0:6712:0:(genops.c:885:class_export_put()) final put ffff88eb07062000/23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:3.0:1790920475.876030:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb07062000/23f7dc83-f18d-4470-88f4-3dd4c845ced7 for lustre-OST0000 00000020:00000080:3.0:1790920475.876083:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb07066000 for lustre-OST0000 00010000:00010000:0.0:1790920476.717422:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920476.778850:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972205056:0@lo:400:kworker.0 00000100:00100000:0.0:1790920476.778935:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920476.779000:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920476.779005:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972205184:0@lo:400:kworker.0 00000100:00100000:0.0:1790920476.779028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920476.779074:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205056 00000100:00100000:0.0:1790920476.779082:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205056 00000100:00100000:0.0:1790920476.779136:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790920476.779145:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972205056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920476.779195:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972205056:12345-0@lo:400:kworker.0 Request processed in 52us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920476.779201:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790920476.779224:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205184 00000100:00100000:0.0:1790920476.779227:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205184 00000100:00100000:0.0:1790920476.779249:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790920476.779255:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972205184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920476.779281:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972205184:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920476.779287:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790920476.779321:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972205184:0@lo:400:kworker.0 00000100:00100000:0.0:1790920476.779330:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972205056:0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780205:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972204928:0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780246:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920476.780266:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972205440:0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780285:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920476.780315:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790920476.780321:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972204800:0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780345:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920476.780366:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972205312:0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790920476.780406:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790920476.780410:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920476.780421:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205440 00000100:00100000:3.0:1790920476.780426:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205440 00000100:00100000:3.0:1790920476.780464:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790920476.780471:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972205440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780509:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972205440:12345-0@lo:400:kworker.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920476.780515:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790920476.780553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204800 00000100:00100000:3.0:1790920476.780557:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204800 00000100:00100000:3.0:1790920476.780582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790920476.780588:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972204800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780618:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972204800:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920476.780623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790920476.780658:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972204928 00000100:00100000:3.0:1790920476.780662:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972204928 00000100:00100000:3.0:1790920476.780682:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205312 00000100:00100000:3.0:1790920476.780684:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205312 00000100:00100000:3.0:1790920476.780703:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790920476.780709:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972204928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780738:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972204928:12345-0@lo:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920476.780743:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790920476.780785:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790920476.780791:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972205312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780817:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972205312:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920476.780822:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1790920476.780842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790920476.780845:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920476.780867:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972204800:0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780878:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972205312:0@lo:400:kworker.0 00000100:00100000:3.0:1790920476.780886:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972204928:0@lo:400:kworker.0 00010000:00080000:3.0:1790920476.780896:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05843480 x1877915972205440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920476.780906:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972205440:0@lo:400:kworker.0 00000100:00100000:0.0:1790920477.289374:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790920477.289404:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972205568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920477.289505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920477.289661:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205568 00000100:00100000:3.0:1790920477.289673:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205568 00000100:00100000:3.0:1790920477.289786:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790920477.289799:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972205568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790920477.289858:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920477.289931:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972205568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920477.289939:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790920477.290130:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972205568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920477.326440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920477.326501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920477.326535:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920477.326574:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951195008 00000100:00100000:1.0:1790920477.326588:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951195008 00000100:00100000:0.0:1790920477.326614:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951194880 00000100:00100000:0.0:1790920477.326619:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951194880 00000100:00100000:1.0:1790920477.326665:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951195136 00000100:00100000:1.0:1790920477.326668:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951195136 00000100:00100000:0.0:1790920477.326671:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 286 00000100:00100000:0.0:1790920477.326681:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951194880:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920477.326690:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:1.0:1790920477.326698:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951195008:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920477.326953:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951194880:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 272us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920477.326962:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 286 00000100:00100000:3.0:1790920477.327057:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 134 00000100:00100000:3.0:1790920477.327067:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951195136:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920477.327783:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951195008:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 1044us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920477.327794:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00080000:1.0:1790920477.327837:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920477.338294:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951195136:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 11210us (11739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920477.338317:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 134 00010000:00010000:1.0:1790920477.738956:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790920478.121534:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790920478.773498:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920478.824912:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972205696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920478.824992:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920478.825278:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205696 00000100:00100000:0.0:1790920478.825289:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205696 00000100:00100000:0.0:1790920478.825351:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790920478.825361:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972205696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790920478.825400:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920478.825447:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972205696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920478.825455:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1790920478.825476:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790920478.825508:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05843480 x1877915972205696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920478.825526:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972205696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790920479.787217:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920480.817792:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790920481.824350:0:11860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:54:39 (1790920479) 00010000:00010000:2.0:1790920481.845990:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920481.897377:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972206080:0@lo:400:kworker.0 00000100:00100000:3.0:1790920481.897454:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920481.897518:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920481.897525:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972206208:0@lo:400:kworker.0 00000100:00100000:3.0:1790920481.897551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920481.897687:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972205824:0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.897739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920481.897791:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972206336:0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.897813:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920481.897842:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790920481.897848:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972205952:0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.897869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920481.897894:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972206464:0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.897916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920481.897946:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972206080 00000100:00100000:1.0:1790920481.897953:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972206080 00000100:00100000:1.0:1790920481.898015:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972206336 00000100:00100000:1.0:1790920481.898018:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972206336 00000100:00100000:1.0:1790920481.898032:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205952 00000100:00100000:1.0:1790920481.898034:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205952 00000100:00100000:1.0:1790920481.898048:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790920481.898175:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972206080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898233:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972206080:12345-0@lo:400:kworker.0 Request processed in 178us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920481.898241:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790920481.898262:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790920481.898269:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972206336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898301:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972206336:12345-0@lo:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920481.898307:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790920481.898387:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790920481.898394:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898422:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972205952:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920481.898428:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790920481.898454:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972206208 00000100:00100000:1.0:1790920481.898457:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972206208 00000100:00100000:1.0:1790920481.898484:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972206464 00000100:00100000:1.0:1790920481.898487:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972206464 00000100:00100000:1.0:1790920481.898508:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790920481.898523:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972206208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898554:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972206208:12345-0@lo:400:kworker.0 Request processed in 33us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920481.898560:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790920481.898570:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790920481.898575:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972206464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898599:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972206464:12345-0@lo:400:kworker.0 Request processed in 24us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920481.898605:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1790920481.898619:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920481.898623:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790920481.898626:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920481.898670:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972206208:0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898683:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972206080:0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898715:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972205952:0@lo:400:kworker.0 00010000:00080000:1.0:1790920481.898726:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3fe73100 x1877915972206464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790920497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920481.898736:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972206464:0@lo:400:kworker.0 00000100:00100000:1.0:1790920481.898775:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972206336:0@lo:400:kworker.0 00000100:00100000:3.0:1790920481.899168:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972205824 00000100:00100000:3.0:1790920481.899174:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972205824 00000100:00100000:3.0:1790920481.899208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1790920481.899215:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920481.899252:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972205824:12345-0@lo:400:kworker.0 Request processed in 39us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920481.899258:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790920481.899519:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972205824:0@lo:400:kworker.0 00000100:00100000:0.0:1790920482.414029:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790920482.414061:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972206592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920482.414157:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920482.414331:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972206592 00000100:00100000:2.0:1790920482.414340:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972206592 00000100:00100000:2.0:1790920482.414403:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790920482.414412:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972206592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920482.414473:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920482.414533:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972206592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920482.414541:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790920482.415297:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972206592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920482.446235:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920482.446287:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920482.446350:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920482.446383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951195520 00000100:00100000:1.0:1790920482.446395:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951195520 00000100:00100000:1.0:1790920482.446464:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951195392 00000100:00100000:1.0:1790920482.446468:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951195392 00000100:00100000:1.0:1790920482.446493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00100000:1.0:1790920482.446505:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951195520:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920482.446590:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951195520:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920482.446597:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00100000:1.0:1790920482.446633:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 139 00000100:00100000:1.0:1790920482.446640:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951195392:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920482.446668:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951195392:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920482.446674:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 139 00000100:00080000:1.0:1790920482.446690:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920482.447044:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951195264 00000100:00100000:0.0:1790920482.447050:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951195264 00000100:00100000:0.0:1790920482.447089:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 288 00000100:00100000:0.0:1790920482.447096:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951195264:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920482.447127:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951195264:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 31us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920482.447134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 288 00010000:00010000:1.0:1790920482.857055:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920483.881260:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920483.946860:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920483.946884:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972206720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920483.946962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920483.947574:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972206720 00000100:00100000:0.0:1790920483.947583:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972206720 00000100:00100000:0.0:1790920483.947669:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790920483.947681:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972206720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790920483.947722:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920483.947813:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972206720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920483.947821:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1790920483.947868:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f655880 x1877915972206720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920483.947891:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972206720:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790920483.948254:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920484.107911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920484.108080:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951195648 00000100:00100000:1.0:1790920484.108092:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951195648 00000100:00100000:1.0:1790920484.108186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:1.0:1790920484.108198:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:10232:x1877915951195648:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920484.108219:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920484.108252:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaaa1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.108324:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a34d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.108349:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a34d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.108636:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a34d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920484.108688:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790920484.108694:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920484.108736:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a34d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.108811:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaa1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.108833:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a34d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaa1 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.108842:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920484.108845:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790920484.108849:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139d400, rc 0) 00000100:00100000:1.0:1790920484.108965:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:10232:x1877915951195648:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 770us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920484.108972:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00080000:2.0:1790920484.109319:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920484.123495:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920484.125030:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951195776 00000100:00100000:1.0:1790920484.125044:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951195776 00000100:00100000:1.0:1790920484.125133:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:1.0:1790920484.125146:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:10233:x1877915951195776:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920484.125169:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920484.125210:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a354 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaaa8 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.125302:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.125320:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.125334:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.125351:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.125370:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.125378:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.125644:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef400/0x2a4915844546a369 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.126828:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef400/0x2a4915844546a369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.126841:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef400/0x2a4915844546a369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920484.138162:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790920484.138174:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920484.138222:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef400/0x2a4915844546a369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138244:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138252:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138280:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138286:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cf200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920484.138302:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138312:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138329:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920484.138332:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920484.138337:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138344:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb421cf200/0x2a4915844546a35b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138365:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138372:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138378:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138383:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029efe00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920484.138387:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138403:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138412:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88eb01486f00) 00010000:00010000:0.0:1790920484.138414:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920484.138417:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138422:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a362 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138469:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaa8 expref: 8 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138486:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef400/0x2a4915844546a369 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaa8 expref: 7 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920484.138493:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88eb01486600) 00010000:00010000:0.0:1790920484.138496:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920484.138498:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb029ef400, rc 0) 00000100:00100000:0.0:1790920484.138697:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:10233:x1877915951195776:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 13552us (15212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920484.138707:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:3.0:1790920484.143738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920484.143937:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951196032 00000100:00100000:1.0:1790920484.143948:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951196032 00000100:00100000:1.0:1790920484.144069:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:1.0:1790920484.144096:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:10233:x1877915951196032:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920484.144122:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920484.144147:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef200/0x2a4915844546a370 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaaaf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144237:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144253:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144267:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144359:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144368:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144375:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144814:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546a385 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144823:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546a385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.144831:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546a385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920484.144852:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790920484.145006:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145014:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145020:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145026:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029efe00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920484.145030:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145038:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145051:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88eb01486600) 00010000:00010000:1.0:1790920484.145054:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920484.145059:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145065:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029efe00/0x2a4915844546a377 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145078:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145084:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145100:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145106:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920484.145109:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145115:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145124:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88eb01486800) 00010000:00010000:1.0:1790920484.145126:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920484.145129:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145135:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a37e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145632:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef200/0x2a4915844546a370 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaaf expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145649:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546a385 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaaf expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920484.145656:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:1.0:1790920484.145658:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920484.145661:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c600, rc 0) 00000100:00100000:1.0:1790920484.145732:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:10233:x1877915951196032:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1639us (2006us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790920484.145800:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:3.0:1790920484.157265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920484.157374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951196160 00000100:00100000:2.0:1790920484.157386:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951196160 00000100:00100000:2.0:1790920484.157510:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:2.0:1790920484.157520:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:10233:x1877915951196160:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790920484.157647:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:10233:x1877915951196160:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920484.157655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000040:00080000:1.0:1790920484.265570:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790920484.905909:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920485.928975:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790920486.097117:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1790920486.447286:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920486.448656:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951196288 00000100:00100000:1.0:1790920486.448675:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951196288 00000100:00100000:0.0:1790920486.452364:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:0.0:1790920486.452386:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:10275:x1877915951196288:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920486.452415:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920486.452444:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaab6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452547:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452566:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452581:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452598:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452605:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452613:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452895:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452905:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452913:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452920:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920486.452926:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452945:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452962:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920486.452965:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920486.452972:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452979:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a39a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452993:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.452999:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453006:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453011:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920486.453014:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453020:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453027:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88eb0856f900) 00010000:00010000:0.0:1790920486.453030:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920486.453032:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453048:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453089:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a393 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaab6 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453100:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920486.453102:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920486.453105:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaab6 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.453118:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031c00, rc 0) 00000100:00100000:0.0:1790920486.453225:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:10275:x1877915951196288:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 846us (5954us total) trans 0 rc 301/301 00000100:00100000:0.0:1790920486.453233:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00080000:1.0:1790920486.458592:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920486.459187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920486.459262:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951196544 00000100:00100000:1.0:1790920486.459277:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951196544 00000100:00100000:2.0:1790920486.459427:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:2.0:1790920486.459460:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:10275:x1877915951196544:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:2.0:1790920486.459542:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920486.459577:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a34d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaa1 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.459601:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920486.459617:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920486.460022:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.460038:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.460051:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.460065:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.460073:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.460080:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920486.461613:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790920486.461634:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.461646:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.461667:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.461675:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920486.461680:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.461690:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.461710:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb2cb2cc00) 00010000:00010000:2.0:1790920486.461713:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920486.461719:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.461726:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546a3a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920486.461801:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bb10dee reply state 0000000045989de8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920486.461813:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920486.461974:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:10275:x1877915951196544:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 2513us (2790us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790920486.461985:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00010000:00010000:2.0:1790920486.464221:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.464246:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.464268:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.464276:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ae00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920486.464281:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.464290:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.464312:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88eb2cb2c100) 00010000:00010000:2.0:1790920486.464316:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920486.464322:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.464329:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a3af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920486.615977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920486.621800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951196672 00000100:00100000:2.0:1790920486.621823:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951196672 00000100:00100000:3.0:1790920486.625563:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:3.0:1790920486.625591:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:10283:x1877915951196672:12345-192.168.204.34@tcp:101:lctl.0 00010000:00010000:3.0:1790920486.625627:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920486.625661:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a3b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaabd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.625774:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546a3bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.625792:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546a3bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.625807:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546a3bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920486.625858:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790920486.625863:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920486.625912:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546a3bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.625941:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a3b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaabd expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.625963:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546a3bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaabd expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.625995:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:3.0:1790920486.625999:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920486.626004:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37600, rc 0) 00000100:00100000:3.0:1790920486.626086:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:10283:x1877915951196672:12345-192.168.204.34@tcp:101:lctl.0 Request processed in 508us (10124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920486.626093:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:1.0:1790920486.713024:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920486.713254:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951196800 00000100:00100000:0.0:1790920486.713270:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951196800 00000100:00100000:0.0:1790920486.713359:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:0.0:1790920486.713372:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:10289:x1877915951196800:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920486.713401:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920486.713430:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaac4 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713717:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713786:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713800:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713827:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713833:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713838:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713963:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a3d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713971:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.713977:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920486.714010:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790920486.714015:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920486.714062:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714078:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714096:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714103:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714109:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920486.714114:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714123:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714137:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:0.0:1790920486.714141:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920486.714147:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714153:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a3cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714173:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714180:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714187:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714192:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920486.714201:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714208:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714215:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88eb0856f900) 00010000:00010000:0.0:1790920486.714218:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920486.714221:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714227:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a3d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714267:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a3c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaac4 expref: 11 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714285:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaac4 expref: 10 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920486.714292:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920486.714295:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790920486.714297:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031200, rc 0) 00000100:00100000:0.0:1790920486.714444:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:10289:x1877915951196800:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1075us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920486.714453:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:0.0:1790920486.725228:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920486.726768:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951197056 00000100:00100000:3.0:1790920486.726788:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951197056 00000100:00100000:3.0:1790920486.727602:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:3.0:1790920486.727616:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:10289:x1877915951197056:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1790920486.727659:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920486.727691:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546a3e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaacb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.728599:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.728625:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.728641:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.728997:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.729021:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.729052:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790920486.731018:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1790920486.734059:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734083:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734096:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734141:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734147:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734155:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734161:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920486.734165:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734182:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734196:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920486.734199:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920486.734228:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.734236:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a3e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920486.736532:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dc316a8 reply state 0000000028e73fb6 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920486.736543:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790920486.736603:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546a3e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.736620:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920486.736629:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920486.736633:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920486.736635:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37400, rc 0) 00000100:00100000:3.0:1790920486.737406:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:10289:x1877915951197056:12345-192.168.204.34@tcp:101:bash.0 Request processed in 9788us (12189us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790920486.737417:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00010000:00010000:1.0:1790920486.748006:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.748023:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.748031:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.748038:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920486.748043:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.748051:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.748067:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb04d19100) 00010000:00010000:1.0:1790920486.748070:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920486.748075:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.748081:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a3ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920486.758610:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920486.758929:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951197184 00000100:00100000:1.0:1790920486.758939:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951197184 00000100:00100000:1.0:1790920486.758994:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1790920486.759002:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1877915951197184:12345-192.168.204.34@tcp:8:bash.0 00010000:00080000:1.0:1790920486.759035:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:1.0:1790920486.759067:0:6689:0:(genops.c:1384:class_connect()) connect: client 23f7dc83-f18d-4470-88f4-3dd4c845ced7, cookie 0x2a4915844546a403 00002000:00100000:1.0:1790920486.759079:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 23f7dc83-f18d-4470-88f4-3dd4c845ced7/ffff88eb3a6af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790920486.759103:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790920486.759630:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790920486.759663:0:6689:0:(import.c:65:import_set_state_nolock()) ffff88eb3a6ac800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790920486.760020:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2351:x1877915951197184:12345-192.168.204.34@tcp:8:bash.0 Request processed in 1016us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920486.760030:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:3.0:1790920486.764135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920486.764675:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951197312 00000100:00100000:1.0:1790920486.764686:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951197312 00000100:00100000:1.0:1790920486.764864:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1790920486.764873:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:0:x1877915951197312:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920486.764891:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920486.764915:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaad2 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790920486.764945:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790920486.764964:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1790920486.764968:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920486.764991:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.765011:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.765024:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d600, rc 0) 00000100:00080000:2.0:1790920486.765166:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920486.765325:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:0:x1877915951197312:12345-192.168.204.34@tcp:101:bash.0 Request processed in 451us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920486.765343:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:2.0:1790920486.774979:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920486.780829:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951197440 00000100:00100000:3.0:1790920486.780846:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951197440 00000100:00100000:2.0:1790920486.782199:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:2.0:1790920486.782225:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:10289:x1877915951197440:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1790920486.782245:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920486.782270:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaad9 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.782303:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.782327:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920486.782332:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920486.782338:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.782373:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920486.782385:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 8 pid: 6688 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920486.782399:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877915972206848:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920486.782500:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f1000 going to sleep for 11 seconds 00000100:00100000:1.0:1790920486.785113:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877915972206848:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920486.785150:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.785181:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ae00, rc 0) 00000100:00100000:1.0:1790920486.785356:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:10289:x1877915951197440:12345-192.168.204.34@tcp:101:bash.0 Request processed in 3134us (10384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920486.785366:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:2.0:1790920486.792993:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920486.793243:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951197568 00000100:00100000:1.0:1790920486.793261:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951197568 00010000:00010000:1.0:1790920486.793305:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 8 pid: 6688 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920486.796809:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:1.0:1790920486.796831:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951197568:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920486.796851:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920486.796893:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 8 pid: 6688 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.796911:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 8 pid: 6688 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.796936:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a40a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad2 expref: 8 pid: 6688 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.796954:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920486.796958:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920486.796965:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.796975:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.797014:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920486.797029:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1877915972206976:192.168.204.34@tcp:105: 00000100:00100000:1.0:1790920486.797106:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3fb14000 going to sleep for 11 seconds 00000100:00100000:2.0:1790920486.813740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920486.813922:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951197824 00000100:00100000:3.0:1790920486.813934:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951197824 00000100:00100000:3.0:1790920486.813996:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:3.0:1790920486.814007:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:10289:x1877915951197824:12345-192.168.204.34@tcp:35:bash.0 00000001:00080000:3.0:1790920486.814313:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:3.0:1790920486.814457:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:10289:x1877915951197824:12345-192.168.204.34@tcp:35:bash.0 Request processed in 451us (741us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790920486.814465:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000020:00080000:3.0:1790920486.814470:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790920486.815154:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1877915972206976:192.168.204.34@tcp:105: 00010000:00010000:1.0:1790920486.815189:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920486.815230:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951197568:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 18408us (22247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920486.815258:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00010000:00010000:3.0:1790920486.953060:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920486.984964:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920486.985078:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951198080 00000100:00100000:1.0:1790920486.985090:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951198080 00000100:00100000:1.0:1790920486.985151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:1.0:1790920486.985161:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:10299:x1877915951198080:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920486.985186:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920486.985208:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaae0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920486.985300:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790920486.985440:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a418 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaae0 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.985456:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:1.0:1790920486.985459:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920486.985476:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaae0 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920486.985491:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d600, rc 0) 00000100:00100000:1.0:1790920486.985553:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:10299:x1877915951198080:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 393us (599us total) trans 4294967314 rc 301/301 00000100:00100000:1.0:1790920486.985561:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:3.0:1790920486.992883:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920486.993379:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951198336 00000100:00100000:2.0:1790920486.993390:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951198336 00000100:00100000:2.0:1790920486.993452:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:2.0:1790920486.993463:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:10299:x1877915951198336:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1790920486.993735:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:10299:x1877915951198336:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 273us (861us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790920486.993743:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1790920487.018183:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972207360:0@lo:400:kworker.0 00000100:00100000:0.0:1790920487.018267:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920487.018343:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972207360 00000100:00100000:0.0:1790920487.018366:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972207360 00000100:00100000:0.0:1790920487.018420:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790920487.018430:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972207360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920487.018484:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972207360:12345-0@lo:400:kworker.0 Request processed in 55us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.018491:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790920487.018535:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972207360:0@lo:400:kworker.0 00000100:00100000:0.0:1790920487.018576:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972207488:0@lo:400:kworker.0 00000100:00100000:0.0:1790920487.018605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920487.018880:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972207104:0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.018916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920487.018958:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972207616:0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.018995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920487.019016:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790920487.019021:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972207232:0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.019040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920487.019057:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972207744:0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.019077:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920487.019104:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972207488 00000100:00100000:1.0:1790920487.019108:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972207488 00000100:00100000:1.0:1790920487.019138:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972207744 00000100:00100000:1.0:1790920487.019141:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972207744 00000100:00100000:1.0:1790920487.019160:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790920487.019167:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972207488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.019204:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972207488:12345-0@lo:400:kworker.0 Request processed in 38us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.019210:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790920487.019225:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790920487.019231:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972207744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.019261:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972207744:12345-0@lo:400:kworker.0 Request processed in 31us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.019267:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790920487.019293:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972207488:0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.019319:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972207744:0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.019336:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972207616 00000100:00100000:1.0:1790920487.019339:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972207616 00000100:00100000:1.0:1790920487.019364:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972207232 00000100:00100000:1.0:1790920487.019367:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972207232 00000100:00100000:1.0:1790920487.019395:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790920487.019401:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972207616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.019434:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972207616:12345-0@lo:400:kworker.0 Request processed in 34us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.019440:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790920487.019453:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790920487.019458:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972207232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920487.020103:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972207616:0@lo:400:kworker.0 00000100:00100000:1.0:1790920487.020855:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972207232:12345-0@lo:400:kworker.0 Request processed in 1393us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.020864:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790920487.020904:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972207232:0@lo:400:kworker.0 00000100:00080000:2.0:1790920487.021031:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920487.021049:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920487.021053:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920487.021499:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972207104 00000100:00100000:0.0:1790920487.021506:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972207104 00000100:00100000:0.0:1790920487.021555:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790920487.021563:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972207104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920487.021616:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972207104:12345-0@lo:400:kworker.0 Request processed in 54us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.021623:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790920487.021660:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972207104:0@lo:400:kworker.0 00000001:00100000:3.0:1790920487.065902:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000100:00100000:2.0:1790920487.116397:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920487.117969:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951198464 00000100:00100000:3.0:1790920487.117983:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951198464 00000100:00100000:3.0:1790920487.118059:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:3.0:1790920487.118067:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:10305:x1877915951198464:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920487.118090:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920487.118112:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaae7 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.118185:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a42d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.118197:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.118209:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920487.118245:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790920487.118249:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920487.118273:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.118319:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaae7 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.118437:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a42d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaae7 expref: 17 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.118445:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920487.118447:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920487.118450:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37e00, rc 0) 00000100:00100000:3.0:1790920487.118576:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:10305:x1877915951198464:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 509us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920487.118582:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:3.0:1790920487.135010:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.135290:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951198720 00000100:00100000:0.0:1790920487.135301:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951198720 00000100:00100000:0.0:1790920487.135365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:0.0:1790920487.135375:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:10305:x1877915951198720:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920487.135394:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920487.135414:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaaee expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.135527:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a43b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.135542:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a43b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.135553:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a43b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920487.135563:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790920487.135686:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaee expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.135705:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a43b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaee expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.135713:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:0.0:1790920487.135725:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920487.135729:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031600, rc 0) 00000100:00100000:0.0:1790920487.135845:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10305:x1877915951198720:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 471us (845us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790920487.135852:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:1.0:1790920487.141232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920487.141339:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951198848 00000100:00100000:3.0:1790920487.141353:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951198848 00000100:00100000:3.0:1790920487.141435:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:3.0:1790920487.141445:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:2355:x1877915951198848:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920487.141460:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920487.141488:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a43b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaee expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.141508:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920487.141513:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920487.141582:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:2355:x1877915951198848:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 138us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920487.141589:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:3.0:1790920487.151138:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.151307:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951199104 00000100:00100000:0.0:1790920487.151316:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951199104 00000100:00100000:0.0:1790920487.151375:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:0.0:1790920487.151384:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:10305:x1877915951199104:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920487.151406:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920487.151439:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaaf5 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.151534:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a450 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.151548:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a450 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.151558:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a450 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920487.151569:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790920487.151704:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaf5 expref: 21 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.151732:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a450 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaf5 expref: 20 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.151806:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:0.0:1790920487.151810:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790920487.151814:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031600, rc 0) 00000100:00100000:0.0:1790920487.151877:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:10305:x1877915951199104:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 494us (749us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790920487.151884:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:2.0:1790920487.163298:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.163448:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951199232 00000100:00100000:1.0:1790920487.163462:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951199232 00000100:00100000:1.0:1790920487.163536:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:1.0:1790920487.163548:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951199232:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:1.0:1790920487.163613:0:8267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.163637:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.163647:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790920487.163652:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920487.163658:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.163725:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.163796:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 6 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920487.163816:0:8267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1877915972207872:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920487.163936:0:8267:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3fb14000 going to sleep for 11 seconds 00000100:00100000:0.0:1790920487.169156:0:8267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1877915972207872:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920487.169195:0:8267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920487.172134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.172688:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951199360 00000100:00100000:1.0:1790920487.172702:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951199360 00002000:00100000:1.0:1790920487.172941:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88eb3af2d180 x1877915951199360/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:98/0 lens 504/0 e 0 to 0 dl 1790920498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920487.172955:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3af2d180 with x1877915951199360 ext(0->12) 00010000:00010000:1.0:1790920487.172966:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 7 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.172986:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 7 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790920487.172995:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb3af2d180 00000100:00100000:0.0:1790920487.173150:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1790920487.173165:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951199360:12345-192.168.204.34@tcp:4:lfs.0 00000100:00100000:0.0:1790920487.174257:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951199360:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 1090us (2131us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790920487.174271:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00002000:00100000:0.0:1790920487.174282:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88eb3af2d180 x1877915951199360/t4294967299(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:98/0 lens 504/448 e 0 to 0 dl 1790920498 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790920487.174294:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3af2d180 with x1877915951199360 ext(0->12) 00010000:00010000:0.0:1790920487.174305:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.174614:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790920487.174627:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb3af2d180 00000100:00100000:1.0:1790920487.178995:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.179409:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951199488 00000100:00100000:0.0:1790920487.179428:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951199488 00010000:00010000:0.0:1790920487.179630:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920487.179693:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:0.0:1790920487.179705:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2353:x1877915951199488:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920487.179737:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790920487.180684:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790920487.180689:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790920487 00002000:00010000:0.0:1790920487.180692:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790920487 00002000:00010000:0.0:1790920487.180695:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790920487 00010000:00010000:0.0:1790920487.180707:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.180737:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.180911:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006228a3af/0x2a4915844546a411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaad9 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.180934:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790920487.180940:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790920487.180947:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.180958:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.181039:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920487.181117:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2353:x1877915951199488:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 1412us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.181127:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00010000:00010000:1.0:1790920487.186593:0:8267:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.186622:0:8267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.189647:0:8267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.189703:0:8267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.189724:0:8267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.189733:0:8267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920487.189738:0:8267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.189765:0:8267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.189792:0:8267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.189800:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dddf142c/0x2a4915844546a45e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920487.189947:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951199232:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 26394us (26657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.189959:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:1.0:1790920487.194365:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920487.195104:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951199744 00000100:00100000:3.0:1790920487.195122:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951199744 00000100:00100000:3.0:1790920487.195209:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1790920487.195222:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:10305:x1877915951199744:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:3.0:1790920487.195336:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a450 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaf5 expref: 20 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790920487.195787:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1790920487.195834:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1790920487.196484:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:3.0:1790920487.196555:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.196578:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.196590:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.196636:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920487.196655:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 24 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920487.196672:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe70000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972208000:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920487.196831:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790920487.203156:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe70000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972208000:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920487.203199:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920487.203438:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.205238:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951199872 00000100:00100000:1.0:1790920487.205256:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951199872 00010000:00010000:1.0:1790920487.205340:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920487.205397:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:1.0:1790920487.205410:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+25:2354:x1877915951199872:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920487.205431:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920487.205440:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.205953:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.205991:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a3f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaacb expref: 25 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.206014:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:1.0:1790920487.206021:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.206031:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.206039:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.206097:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920487.206235:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.206246:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920487.206427:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:0.0:1790920487.206679:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1790920487.206912:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972208128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920487.206991:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920487.207032:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05134900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920487.207071:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972208128 00000100:00100000:0.0:1790920487.207079:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972208128 00000100:00100000:0.0:1790920487.207122:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920487.207132:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877915972208128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920487.207213:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877915972208128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.207222:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920487.207276:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972208128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790920487.208046:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1790920487.208129:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972208256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920487.208178:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920487.208217:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972208256 00000100:00100000:0.0:1790920487.208223:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972208256 00000100:00100000:0.0:1790920487.208259:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920487.208267:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877915972208256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920487.208444:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1877915972208256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (265us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790920487.208451:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920487.208477:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05134000 going to sleep for 11 seconds 00000100:00100000:0.0:1790920487.208502:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972208256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790920487.208552:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1790920487.208590:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.208602:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.208611:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.208617:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920487.208621:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.208630:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.208647:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:0.0:1790920487.208651:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790920487.208658:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.208664:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a465 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790920487.208951:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1790920487.209426:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:2354:x1877915951199872:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 4014us (5985us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.209439:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00000040:00080000:0.0:1790920487.210583:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1790920487.210608:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329376860154ns, next at 330376856427ns, rc = 0 00000001:00080000:0.0:1790920487.210626:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1790920487.210702:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:0.0:1790920487.210707:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790920487.210729:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a450 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaf5 expref: 28 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920487.211048:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:10305:x1877915951199744:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 15828us (16697us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1790920487.211060:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000020:00080000:0.0:1790920487.211067:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790920487.213501:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.214308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951200000 00000100:00100000:0.0:1790920487.214332:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951200000 00000100:00100000:0.0:1790920487.214411:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:0.0:1790920487.214422:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:10305:x1877915951200000:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920487.214453:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920487.214483:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a46c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaafc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.215729:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a46c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaafc expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.216636:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a46c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaafc expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.216688:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920487.216691:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790920487.216729:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031c00, rc 0) 00000100:00100000:0.0:1790920487.216855:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:10305:x1877915951200000:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2433us (3363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.216865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:1.0:1790920487.222817:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.223053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951200256 00000100:00100000:0.0:1790920487.223067:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951200256 00000100:00100000:0.0:1790920487.223152:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1790920487.223165:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:10305:x1877915951200256:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1790920487.223506:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:10305:x1877915951200256:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 342us (702us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1790920487.223514:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1790920487.354903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.355028:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951200512 00000100:00100000:0.0:1790920487.355042:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951200512 00000100:00100000:0.0:1790920487.355123:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:0.0:1790920487.355137:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:10315:x1877915951200512:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920487.355173:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920487.355202:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab03 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920487.355334:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790920487.355495:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a473 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab03 expref: 31 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.355513:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:0.0:1790920487.355517:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920487.355524:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab03 expref: 31 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.355565:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031600, rc 0) 00000100:00100000:0.0:1790920487.355652:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:10315:x1877915951200512:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 519us (764us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1790920487.355660:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:3.0:1790920487.367242:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.367362:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951200640 00000100:00100000:1.0:1790920487.367376:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951200640 00000100:00100000:1.0:1790920487.367453:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:1.0:1790920487.367475:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:10315:x1877915951200640:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:1.0:1790920487.367591:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367615:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367631:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367652:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367659:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367667:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367853:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367883:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367891:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790920487.367950:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367965:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367973:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367981:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.367989:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ca00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920487.367994:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368003:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368018:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920487.368022:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920487.368028:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368034:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368060:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368066:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368073:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368078:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920487.368082:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368088:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368095:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486900) 00010000:00010000:1.0:1790920487.368098:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920487.368101:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368107:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a488 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368126:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368133:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368139:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368151:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920487.368154:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368161:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368169:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920487.368172:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920487.368175:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.368181:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a48f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920487.368287:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:10315:x1877915951200640:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 821us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.368296:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:1.0:1790920487.377144:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920487.377245:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951200896 00000100:00100000:2.0:1790920487.377259:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951200896 00000100:00100000:2.0:1790920487.377337:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:2.0:1790920487.377349:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:10315:x1877915951200896:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1790920487.378251:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:10315:x1877915951200896:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 898us (1120us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790920487.378261:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:3.0:1790920487.435228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.435911:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951201152 00000100:00100000:0.0:1790920487.435926:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951201152 00000100:00100000:0.0:1790920487.436009:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:0.0:1790920487.436022:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:10318:x1877915951201152:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920487.436056:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920487.436087:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a496 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab0a expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436198:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436219:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436235:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436255:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436263:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436271:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436450:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436459:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436467:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920487.436478:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790920487.436603:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436611:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436618:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436624:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920487.436629:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436638:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436651:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920487.436655:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920487.436660:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436677:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a49d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436695:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436701:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436707:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436724:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139d400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920487.436728:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436734:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.436742:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb0856f900) 00010000:00010000:0.0:1790920487.439249:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920487.439272:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.439287:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139d400/0x2a4915844546a4a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.439409:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a496 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 34 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.439461:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 33 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.439470:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920487.439473:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920487.439475:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb0139cc00, rc 0) 00000100:00100000:0.0:1790920487.439586:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:10318:x1877915951201152:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 3565us (4372us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1790920487.439597:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:3.0:1790920487.451399:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.451721:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951201280 00000100:00100000:1.0:1790920487.451735:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951201280 00000100:00100000:1.0:1790920487.452060:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1790920487.452073:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:10318:x1877915951201280:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:1.0:1790920487.452169:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452193:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452232:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452270:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452278:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452287:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452294:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920487.452299:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452308:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452324:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920487.452328:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920487.452334:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.452340:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920487.452505:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:10318:x1877915951201280:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 434us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.452514:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1790920487.458699:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.458956:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951201536 00000100:00100000:0.0:1790920487.458972:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951201536 00000100:00100000:0.0:1790920487.459053:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1790920487.459066:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:10318:x1877915951201536:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1790920487.459402:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:10318:x1877915951201536:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 337us (718us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1790920487.459411:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1790920487.529640:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972208384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920487.529741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920487.530178:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972208384 00000100:00100000:2.0:1790920487.530190:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972208384 00000100:00100000:2.0:1790920487.530255:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790920487.530266:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972208384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920487.530311:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920487.530382:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972208384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920487.530389:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790920487.530629:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972208384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920487.564162:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920487.564221:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.565400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951201792 00000100:00100000:0.0:1790920487.565419:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951201792 00000100:00100000:0.0:1790920487.565549:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 143 00000100:00100000:0.0:1790920487.565563:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951201792:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920487.565889:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951201792:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 328us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.565918:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 143 00000100:00080000:2.0:1790920487.568256:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920487.568598:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951201664 00000100:00100000:1.0:1790920487.568615:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951201664 00000100:00100000:1.0:1790920487.568724:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 290 00000100:00100000:1.0:1790920487.568737:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951201664:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920487.568859:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951201664:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 124us (4714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.568867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 290 00000100:00100000:3.0:1790920487.761057:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.768532:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951202048 00000100:00100000:1.0:1790920487.768555:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951202048 00000100:00100000:1.0:1790920487.768676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:1.0:1790920487.768689:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:10349:x1877915951202048:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:1.0:1790920487.768742:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920487.768803:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab11 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.768958:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.768978:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.768994:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920487.769009:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790920487.769246:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab11 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.769285:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab11 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.769295:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920487.769299:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920487.769303:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d800, rc 0) 00000100:00100000:1.0:1790920487.769414:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:10349:x1877915951202048:12345-192.168.204.34@tcp:101:cat.0 Request processed in 728us (8371us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790920487.769423:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:0.0:1790920487.778283:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.778623:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951202176 00000100:00100000:1.0:1790920487.778640:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951202176 00000100:00100000:1.0:1790920487.778816:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:1.0:1790920487.778829:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:2352:x1877915951202176:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920487.778850:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920487.778885:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab11 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.778913:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920487.778928:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920487.779012:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:2352:x1877915951202176:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 184us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920487.779020:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:3.0:1790920487.779963:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.782103:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951202432 00000100:00100000:0.0:1790920487.782126:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951202432 00000100:00100000:0.0:1790920487.782252:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920487.782266:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:10349:x1877915951202432:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:0.0:1790920487.782649:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:10349:x1877915951202432:12345-192.168.204.34@tcp:35:cat.0 Request processed in 383us (2688us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790920487.782659:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:3.0:1790920487.857243:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.857345:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951202688 00000100:00100000:1.0:1790920487.857358:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951202688 00000100:00100000:1.0:1790920487.857447:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:1.0:1790920487.857488:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:10355:x1877915951202688:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:1.0:1790920487.857524:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920487.857529:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790920487.857570:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546a42d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaae7 expref: 36 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.857598:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920487.857604:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920487.857622:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab18 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.858071:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.858092:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 36 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.858104:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.858147:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 36 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.858166:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 36 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920487.858184:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972208512:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920487.860952:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3fb14300 going to sleep for 11 seconds 00000100:00100000:2.0:1790920487.865020:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920487.865140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951202816 00000100:00100000:0.0:1790920487.865156:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951202816 00010000:00010000:0.0:1790920487.865235:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 37 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920487.865421:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:0.0:1790920487.865437:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:2354:x1877915951202816:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920487.865472:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920487.865482:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 37 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.865929:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 37 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.865980:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920487.865988:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.866020:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.866030:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920487.866060:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920487.866145:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:2354:x1877915951202816:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 711us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920487.866154:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00010000:00010000:1.0:1790920487.867919:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb0139cc00/0x2a4915844546a4ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab0a expref: 36 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920487.867950:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972208512:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920487.867978:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.867988:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.867994:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920487.868022:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790920487.868930:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.868958:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.868968:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920487.868971:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790920487.868975:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d200, rc 0) 00000100:00100000:1.0:1790920487.869055:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:10355:x1877915951202688:12345-192.168.204.34@tcp:101:dd.0 Request processed in 11571us (11824us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1790920487.869065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:2.0:1790920487.880684:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920487.880845:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951203072 00000100:00100000:1.0:1790920487.880860:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951203072 00000100:00100000:1.0:1790920487.880934:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:1.0:1790920487.880959:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:10355:x1877915951203072:12345-192.168.204.34@tcp:36:dd.0 00010000:00010000:1.0:1790920487.881370:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.881394:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920487.881410:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920487.881475:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:1.0:1790920487.881502:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f25c773 reply state 000000001e7482c9 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920487.881513:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790920487.881647:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:10355:x1877915951203072:12345-192.168.204.34@tcp:36:dd.0 Request processed in 690us (977us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1790920487.881657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000020:00080000:1.0:1790920487.881665:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790920487.884018:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920487.884041:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920487.884079:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920487.884089:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ca00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920487.884095:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920487.884107:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920487.884130:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:2.0:1790920487.884134:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920487.884140:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920487.884147:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a4ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920487.977207:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920488.295456:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.295562:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951203200 00000100:00100000:1.0:1790920488.295577:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951203200 00000100:00100000:1.0:1790920488.295667:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:1.0:1790920488.295680:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:10369:x1877915951203200:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:1.0:1790920488.295724:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920488.295783:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab1f expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.295868:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.295909:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.295924:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.295943:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.295951:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.295958:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.296100:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.296113:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.296122:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.296169:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.296184:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 39 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920488.296214:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972208640:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920488.296342:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3fb143c0 going to sleep for 11 seconds 00000100:00080000:2.0:1790920488.296705:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920488.299563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.299673:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972208640:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920488.299781:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920488.310064:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951203456 00000100:00100000:2.0:1790920488.310210:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951203456 00000100:00100000:2.0:1790920488.310324:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:2.0:1790920488.310338:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:5592:x1877915951203456:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790920488.313232:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+41:5592:x1877915951203456:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 2880us (13672us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1790920488.313251:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:3.0:1790920488.324211:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920488.329174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951203584 00000100:00100000:0.0:1790920488.329197:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951203584 00010000:00010000:0.0:1790920488.329269:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 41 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920488.329395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:0.0:1790920488.329407:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+41:2355:x1877915951203584:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920488.329425:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920488.329433:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 41 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.329449:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 41 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.329490:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a4dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab18 expref: 41 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.329542:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920488.329548:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.329561:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.329572:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.329617:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920488.329719:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:2355:x1877915951203584:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 313us (5522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920488.329727:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00010000:00010000:2.0:1790920488.329848:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.329858:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920488.329934:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790920488.329939:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920488.329994:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331259:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331276:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331283:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331290:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331296:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920488.331313:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331323:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331338:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:2.0:1790920488.331341:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920488.331345:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331352:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a4f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331389:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331395:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331401:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331406:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920488.331408:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331415:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331424:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486900) 00010000:00010000:2.0:1790920488.331426:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920488.331429:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331434:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a4ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331509:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a4f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab1f expref: 40 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331527:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab1f expref: 39 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.331546:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:2.0:1790920488.331548:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920488.331550:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443ce00, rc 0) 00000100:00100000:3.0:1790920488.331834:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:10369:x1877915951203200:12345-192.168.204.34@tcp:101:stat.0 Request processed in 36153us (36391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920488.331846:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000040:00080000:1.0:1790920488.362345:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790920488.449500:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.451065:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951203840 00000100:00100000:1.0:1790920488.451087:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951203840 00000100:00100000:1.0:1790920488.451186:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:1.0:1790920488.451199:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:10375:x1877915951203840:12345-192.168.204.34@tcp:36:truncate.0 00010000:00010000:1.0:1790920488.451283:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920488.451319:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab1f expref: 39 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.451346:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920488.451352:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920488.451662:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.451686:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.451707:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920488.451849:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1790920488.453468:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6fd2f89 reply state 00000000a84b5b8f transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920488.453483:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790920488.454559:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+41:10375:x1877915951203840:12345-192.168.204.34@tcp:36:truncate.0 Request processed in 2491us (4206us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1790920488.454575:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00000020:00080000:1.0:1790920488.454584:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790920488.462374:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.462401:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.462411:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.462419:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443de00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.462426:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.462436:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.462459:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920488.462462:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.462469:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.462476:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a50d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920488.611014:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.611154:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951203968 00000100:00100000:1.0:1790920488.611189:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951203968 00000100:00100000:1.0:1790920488.611264:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:1.0:1790920488.611276:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:10389:x1877915951203968:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:1.0:1790920488.611364:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920488.611394:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a514 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab26 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611498:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611518:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611533:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611551:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611559:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611565:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611681:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611700:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611707:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920488.611802:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1790920488.611808:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920488.611836:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611850:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611860:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611866:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611873:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611879:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ce00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.611884:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611892:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611905:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920488.611909:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.611915:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611921:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a51b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611948:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611954:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611960:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611965:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.611968:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611975:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611983:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486b00) 00010000:00010000:1.0:1790920488.611986:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.611989:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.611995:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a522 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.612035:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a514 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.612053:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.612076:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920488.612079:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920488.612081:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443cc00, rc 0) 00000100:00100000:1.0:1790920488.612293:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+41:10389:x1877915951203968:12345-192.168.204.34@tcp:101:stat.0 Request processed in 1018us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920488.612312:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:2.0:1790920488.705451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920488.705582:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951204224 00000100:00100000:0.0:1790920488.705597:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951204224 00000100:00100000:0.0:1790920488.705674:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:0.0:1790920488.705696:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+41:10399:x1877915951204224:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920488.705725:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920488.705789:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab2d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920488.705928:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790920488.706099:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a530 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab2d expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.706119:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:0.0:1790920488.706141:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920488.706149:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab2d expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.706167:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031600, rc 0) 00000100:00100000:0.0:1790920488.706413:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+42:10399:x1877915951204224:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 729us (980us total) trans 4294967340 rc 301/301 00000100:00100000:0.0:1790920488.706422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:3.0:1790920488.712127:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920488.712274:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951204480 00000100:00100000:2.0:1790920488.712288:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951204480 00000100:00100000:2.0:1790920488.712362:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:2.0:1790920488.712374:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+42:10399:x1877915951204480:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1790920488.713097:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:10399:x1877915951204480:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 722us (985us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1790920488.713108:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:3.0:1790920488.781916:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.782309:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951204736 00000100:00100000:1.0:1790920488.782328:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951204736 00000100:00100000:1.0:1790920488.782415:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:1.0:1790920488.782428:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:10405:x1877915951204736:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920488.782471:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920488.782504:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a53e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab34 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.782657:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.782676:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.782697:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.782801:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.782819:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 44 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920488.782867:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972208768:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920488.783014:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3fb143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920488.793024:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920488.793349:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951204864 00000100:00100000:0.0:1790920488.793361:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951204864 00010000:00010000:0.0:1790920488.793414:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 45 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920488.793472:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:0.0:1790920488.793484:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:2355:x1877915951204864:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920488.793503:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920488.793512:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 45 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.793528:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 45 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.793557:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920488.793563:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.793576:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.793610:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.793636:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920488.793791:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:2355:x1877915951204864:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 308us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920488.793800:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00010000:00010000:1.0:1790920488.794117:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a529 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab26 expref: 44 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920488.794141:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972208768:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920488.794169:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.794179:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.794185:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920488.794207:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1790920488.794431:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a53e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 45 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.794449:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 44 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.794456:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920488.794459:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790920488.794462:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443de00, rc 0) 00000100:00100000:1.0:1790920488.794497:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+44:10405:x1877915951204736:12345-192.168.204.34@tcp:101:bash.0 Request processed in 12073us (12597us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1790920488.794514:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:3.0:1790920488.803360:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.803442:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951205120 00000100:00100000:1.0:1790920488.803466:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951205120 00000100:00100000:1.0:1790920488.803543:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:1.0:1790920488.803560:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+44:10405:x1877915951205120:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:1.0:1790920488.803981:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.804005:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.804020:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920488.804081:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:1.0:1790920488.804108:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b2f9fd5 reply state 00000000fec3ad60 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920488.804118:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790920488.804251:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:10405:x1877915951205120:12345-192.168.204.34@tcp:36:bash.0 Request processed in 695us (904us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1790920488.804260:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00000020:00080000:1.0:1790920488.804266:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790920488.809019:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.809045:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.809054:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.809062:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920488.809067:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.809076:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.809098:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:2.0:1790920488.809120:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920488.809127:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.809135:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a553 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920488.814105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920488.816286:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951205248 00000100:00100000:2.0:1790920488.816426:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951205248 00000100:00100000:2.0:1790920488.816645:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:2.0:1790920488.816660:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+46:10405:x1877915951205248:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1790920488.816705:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920488.816761:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a55a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab3b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.816889:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.816908:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 47 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.816917:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.816963:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 47 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.816980:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 47 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920488.817022:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972208896:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920488.817150:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f1000 going to sleep for 11 seconds 00000100:00100000:3.0:1790920488.821088:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920488.821226:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972208896:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920488.821267:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920488.821508:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951205376 00000100:00100000:1.0:1790920488.821518:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951205376 00010000:00010000:1.0:1790920488.821564:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 48 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920488.821651:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:1.0:1790920488.821678:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:2354:x1877915951205376:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920488.821714:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920488.821722:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 48 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.821736:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 48 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.821806:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a545 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab34 expref: 48 pid: 11700 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.821827:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920488.821832:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.821845:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.821854:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.821877:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920488.821947:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:2354:x1877915951205376:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 270us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920488.821956:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00010000:00010000:2.0:1790920488.822609:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.822622:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920488.822693:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790920488.822698:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920488.822741:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.822800:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a55a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab3b expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.822821:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab3b expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.822830:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:2.0:1790920488.822833:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920488.822836:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b800, rc 0) 00000100:00100000:2.0:1790920488.822891:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+46:10405:x1877915951205248:12345-192.168.204.34@tcp:101:bash.0 Request processed in 6236us (8801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920488.822909:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:3.0:1790920488.827816:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920488.828018:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951205632 00000100:00100000:0.0:1790920488.828032:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951205632 00000100:00100000:0.0:1790920488.828103:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:0.0:1790920488.828115:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+46:10405:x1877915951205632:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:0.0:1790920488.828563:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:10405:x1877915951205632:12345-192.168.204.34@tcp:35:bash.0 Request processed in 449us (765us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1790920488.828572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:3.0:1790920488.873395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.876718:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951205888 00000100:00100000:1.0:1790920488.876740:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951205888 00000100:00100000:1.0:1790920488.876893:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:1.0:1790920488.876908:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:10415:x1877915951205888:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920488.876975:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920488.877005:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab42 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920488.877131:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790920488.877295:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a568 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab42 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.877314:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:1.0:1790920488.877318:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920488.877325:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab42 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.877346:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443de00, rc 0) 00000100:00100000:1.0:1790920488.877443:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:10415:x1877915951205888:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 538us (4066us total) trans 4294967346 rc 301/301 00000100:00100000:1.0:1790920488.877451:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:3.0:1790920488.883143:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.883252:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951206016 00000100:00100000:1.0:1790920488.883266:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951206016 00000100:00100000:1.0:1790920488.883349:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:1.0:1790920488.883360:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:10415:x1877915951206016:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:1.0:1790920488.883470:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883508:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883525:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883564:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883572:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883579:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883728:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883738:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883784:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790920488.883846:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883863:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883870:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883878:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883885:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443de00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.883890:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883905:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.883921:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920488.883924:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.883930:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884386:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a576 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884412:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884419:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884426:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884431:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443da00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.884434:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884441:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884450:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486b00) 00010000:00010000:1.0:1790920488.884453:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.884462:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884483:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a57d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884504:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884510:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884516:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884521:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443cc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.884524:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884529:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884536:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920488.884538:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.884541:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.884547:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a584 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920488.890831:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:10415:x1877915951206016:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 7453us (7684us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920488.890852:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:0.0:1790920488.898476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920488.898585:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951206272 00000100:00100000:2.0:1790920488.898601:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951206272 00000100:00100000:2.0:1790920488.898696:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:2.0:1790920488.898709:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:10415:x1877915951206272:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1790920488.899089:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:10415:x1877915951206272:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 381us (628us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1790920488.899098:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:3.0:1790920488.940854:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920488.941162:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951206528 00000100:00100000:1.0:1790920488.941176:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951206528 00000100:00100000:1.0:1790920488.941254:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:1.0:1790920488.941265:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:10418:x1877915951206528:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920488.941326:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920488.941358:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a58b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab49 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941479:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941497:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941511:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941528:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941536:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941543:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941726:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a5a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941736:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941787:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920488.941802:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790920488.941956:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941965:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941972:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941979:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443da00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.941984:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.941992:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942007:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920488.942011:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.942017:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942024:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942043:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942050:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942058:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942063:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443de00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920488.942074:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942080:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942088:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486b00) 00010000:00010000:1.0:1790920488.942090:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920488.942093:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942099:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942155:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a58b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab49 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942172:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab49 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920488.942179:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920488.942181:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920488.942184:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443ce00, rc 0) 00000100:00100000:1.0:1790920488.942277:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10418:x1877915951206528:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1012us (1436us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1790920488.942285:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:3.0:1790920488.946999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920488.947144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951206656 00000100:00100000:2.0:1790920488.947158:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951206656 00000100:00100000:2.0:1790920488.947236:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:2.0:1790920488.947248:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10418:x1877915951206656:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1790920488.947357:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947379:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947394:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947430:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947439:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947447:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947472:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920488.947478:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947487:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947504:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:2.0:1790920488.947507:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790920488.947513:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920488.947520:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920488.947628:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10418:x1877915951206656:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 381us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920488.947635:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:0.0:1790920488.950716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920488.950910:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951206912 00000100:00100000:2.0:1790920488.950925:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951206912 00000100:00100000:2.0:1790920488.951001:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1790920488.951013:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10418:x1877915951206912:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1790920488.951567:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10418:x1877915951206912:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 553us (883us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790920488.951579:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:1.0:1790920488.952276:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920488.952384:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951207040 00000100:00100000:0.0:1790920488.952393:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951207040 00000100:00100000:0.0:1790920488.952453:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1790920488.952463:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:2354:x1877915951207040:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920488.952478:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920488.952512:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a5a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab49 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920488.952564:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920488.952570:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920488.952610:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:2354:x1877915951207040:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 147us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920488.952617:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00010000:00010000:3.0:1790920489.002579:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790920489.068668:0:7929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331234917471ns, next at 332234913783ns, rc = 0 00000100:00100000:0.0:1790920489.068862:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972209024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920489.068965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920489.069708:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972209024 00000100:00100000:3.0:1790920489.069721:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972209024 00000100:00080000:2.0:1790920489.069922:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920489.069946:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790920489.069959:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972209024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920489.070010:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920489.070097:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972209024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920489.070106:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790920489.070156:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972209024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920489.115291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.115480:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951207296 00000100:00100000:1.0:1790920489.115514:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951207296 00000100:00100000:1.0:1790920489.115717:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:1.0:1790920489.115730:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10436:x1877915951207296:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:1.0:1790920489.115792:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920489.115823:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a5b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab50 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.115954:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a5bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.115970:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a5bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.115983:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a5bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920489.115996:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790920489.116174:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a5b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab50 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.116200:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a5bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab50 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.116209:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920489.116211:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790920489.116216:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443cc00, rc 0) 00000100:00100000:1.0:1790920489.116323:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10436:x1877915951207296:12345-192.168.204.34@tcp:101:cat.0 Request processed in 595us (1046us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1790920489.116548:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:1.0:1790920489.167853:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.167985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951207424 00000100:00100000:2.0:1790920489.167999:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951207424 00000100:00100000:2.0:1790920489.168169:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:2.0:1790920489.168184:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10438:x1877915951207424:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920489.168222:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920489.168263:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab57 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.168369:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a5d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.168388:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.168403:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920489.168448:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790920489.168454:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920489.168475:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.168507:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a5ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab57 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.168530:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab57 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.168540:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:2.0:1790920489.168543:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920489.168548:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a200, rc 0) 00000100:00100000:2.0:1790920489.168630:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10438:x1877915951207424:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 450us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920489.168643:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:0.0:1790920489.179619:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.180823:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951207808 00000100:00100000:1.0:1790920489.180859:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951207808 00000100:00100000:1.0:1790920489.180945:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:1.0:1790920489.180960:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10438:x1877915951207808:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920489.188046:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10438:x1877915951207808:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 7069us (8424us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1790920489.188079:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:0.0:1790920489.194099:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.194591:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951207936 00000100:00100000:2.0:1790920489.194607:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951207936 00000100:00100000:2.0:1790920489.194716:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:2.0:1790920489.194729:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10438:x1877915951207936:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:2.0:1790920489.194785:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790920489.194826:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a561 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab3b expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.194860:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a5bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab50 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.194876:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a46c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaafc expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.194887:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:2.0:1790920489.194901:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920489.194968:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10438:x1877915951207936:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 240us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920489.194976:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1790920489.210431:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920489.210671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951208064 00000100:00100000:0.0:1790920489.210694:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951208064 00000100:00100000:0.0:1790920489.210783:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:0.0:1790920489.210796:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10438:x1877915951208064:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:0.0:1790920489.210978:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.211001:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.211017:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920489.212698:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790920489.212962:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1790920489.213068:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1790920489.213252:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10438:x1877915951208064:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 2451us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920489.213266:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:0.0:1790920489.263528:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920489.263699:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951208192 00000100:00100000:3.0:1790920489.263713:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951208192 00000100:00100000:3.0:1790920489.263837:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:3.0:1790920489.263851:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10440:x1877915951208192:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920489.263880:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920489.263909:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a5df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab5e expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264000:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264018:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264033:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264072:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264081:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264088:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264207:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264216:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264224:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920489.264270:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790920489.264276:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920489.264314:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264329:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264337:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264345:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264364:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264371:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920489.264376:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264384:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264399:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920489.264402:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920489.264408:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264415:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a5e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264432:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264439:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264445:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264451:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920489.264454:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264470:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264480:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb04d19900) 00010000:00010000:3.0:1790920489.264482:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920489.264485:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264491:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a5ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264532:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a5df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 54 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264548:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 53 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.264555:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f900) 00010000:00010000:3.0:1790920489.264558:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920489.264561:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36400, rc 0) 00000100:00100000:3.0:1790920489.264653:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10440:x1877915951208192:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 805us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920489.264662:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00000040:00080000:1.0:1790920489.385079:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790920489.385094:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790920489.385190:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790920489.385198:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790920489.385371:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f69500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972209152:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790920489.385828:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3fb143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920489.400834:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.400951:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951208320 00000100:00100000:2.0:1790920489.400963:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951208320 00000100:00100000:2.0:1790920489.401026:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:2.0:1790920489.401037:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951208320:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790920489.401157:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951208320:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920489.401187:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:1.0:1790920489.403559:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f69500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972209152:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790920489.408289:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.408431:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951208448 00000100:00100000:1.0:1790920489.408442:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951208448 00000100:00100000:1.0:1790920489.408710:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:1.0:1790920489.408721:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10451:x1877915951208448:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790920489.408792:0:5847:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790920489.408937:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10451:x1877915951208448:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 218us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920489.408946:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:0.0:1790920489.440947:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.441110:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951208576 00000100:00100000:2.0:1790920489.441122:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951208576 00000100:00100000:2.0:1790920489.441200:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:2.0:1790920489.441214:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10451:x1877915951208576:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790920489.441304:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441324:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441338:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441358:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441366:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441374:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441403:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441414:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441422:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920489.441483:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790920489.441496:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920489.441517:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441532:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441540:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441548:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441555:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920489.441560:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441569:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441583:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920489.441586:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920489.441591:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441597:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a5fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441611:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441628:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441633:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441638:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920489.441641:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441647:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441655:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff88eb2cb2c100) 00010000:00010000:2.0:1790920489.441657:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920489.441660:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a602 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441698:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441703:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441709:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441713:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56bc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920489.441721:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441727:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441736:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f900) 00010000:00010000:2.0:1790920489.441738:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920489.441742:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.441793:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920489.441867:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10451:x1877915951208576:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 657us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920489.441875:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:3.0:1790920489.465252:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920489.465967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951208832 00000100:00100000:0.0:1790920489.465978:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951208832 00000100:00100000:0.0:1790920489.466031:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:0.0:1790920489.466040:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10451:x1877915951208832:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920489.466061:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920489.466081:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a610 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab65 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466446:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466473:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466485:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920489.466499:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790920489.466603:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466612:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466629:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466635:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920489.466640:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466648:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466662:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f900) 00010000:00010000:0.0:1790920489.466665:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920489.466680:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466688:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466733:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a610 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab65 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466794:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:0.0:1790920489.466798:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920489.466803:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a610 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab65 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.466814:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb00031c00, rc 0) 00000100:00100000:0.0:1790920489.466887:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951208832:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 847us (1644us total) trans 4294967352 rc 301/301 00000100:00100000:0.0:1790920489.466912:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:1.0:1790920489.483212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920489.483493:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951208960 00000100:00100000:3.0:1790920489.483506:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951208960 00000100:00100000:3.0:1790920489.483578:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:3.0:1790920489.483604:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951208960:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790920489.483656:0:5846:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790920489.483943:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951208960:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 341us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920489.483951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:1.0:1790920489.487324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.487616:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951209216 00000100:00100000:2.0:1790920489.487629:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951209216 00000100:00100000:2.0:1790920489.487718:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:2.0:1790920489.487730:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951209216:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920489.487792:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920489.487797:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790920489.487836:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a5d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab57 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.487862:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:2.0:1790920489.487868:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920489.487885:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a625 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab6c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920489.494321:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1790920489.494638:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a62c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.494659:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.494686:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.494796:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a625 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab6c expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.494821:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab6c expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.494831:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb2cb2c100) 00010000:00010000:2.0:1790920489.494835:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920489.494838:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ac00, rc 0) 00000100:00100000:2.0:1790920489.494944:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10451:x1877915951209216:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 7216us (7635us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1790920489.494954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:1.0:1790920489.499365:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920489.499574:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951209472 00000100:00100000:0.0:1790920489.499589:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951209472 00000100:00100000:0.0:1790920489.499679:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:0.0:1790920489.499692:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10451:x1877915951209472:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790920489.499809:0:11700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920489.499848:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a62c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab6c expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.499875:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb2cb2c100) 00010000:00010000:0.0:1790920489.499897:0:11700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920489.499928:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.499945:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.499958:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500188:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500213:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500227:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500584:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500593:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500600:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500606:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920489.500611:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500619:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500632:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920489.500635:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920489.500640:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500646:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a63a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500661:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500667:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500686:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500709:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920489.500713:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500719:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.500726:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9f362256 (ffff88eb0856fd00) 00010000:00010000:0.0:1790920489.500728:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920489.500731:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920489.501250:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a641 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f362256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920489.501914:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951209472:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 2219us (2558us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790920489.501924:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:0.0:1790920489.508937:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.509129:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951209600 00000100:00100000:1.0:1790920489.509140:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951209600 00000100:00100000:1.0:1790920489.509203:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:1.0:1790920489.509215:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10451:x1877915951209600:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920489.509239:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920489.509267:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a648 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab73 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.509323:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.509340:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.509352:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.509728:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.509785:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.509795:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920489.509798:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790920489.509802:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443de00, rc 0) 00000100:00100000:1.0:1790920489.509878:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10451:x1877915951209600:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 665us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920489.509886:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:1.0:1790920489.513406:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.513560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951209856 00000100:00100000:2.0:1790920489.513578:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951209856 00000100:00100000:2.0:1790920489.513685:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:2.0:1790920489.513697:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10451:x1877915951209856:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790920489.513837:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.513875:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.513892:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790920489.514430:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1790920489.514449:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331680700663ns, next at 332680697277ns, rc = 0 00000004:00010000:2.0:1790920489.514560:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045de7593 reply state 000000004acf3c95 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920489.514573:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920489.514722:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:10451:x1877915951209856:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 1024us (1325us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1790920489.514731:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 75 00010000:00010000:3.0:1790920489.519717:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.519743:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.519777:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.519785:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920489.519792:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.519801:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.519826:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:3.0:1790920489.519830:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790920489.519837:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.519845:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920489.523264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.525939:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951209984 00000100:00100000:2.0:1790920489.525962:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951209984 00000100:00100000:2.0:1790920489.526065:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:2.0:1790920489.526080:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10451:x1877915951209984:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920489.526114:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920489.526145:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab7a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.526232:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.526251:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920489.526304:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920489.526308:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920489.526313:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56bc00, rc 0) 00000100:00100000:2.0:1790920489.526411:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:10451:x1877915951209984:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 334us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920489.526420:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:1.0:1790920489.538847:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920489.539818:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951210112 00000100:00100000:3.0:1790920489.539845:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951210112 00000100:00100000:2.0:1790920489.549985:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:2.0:1790920489.550001:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1877915951210112:12345-192.168.204.34@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1790920489.550049:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:2.0:1790920489.550102:0:6689:0:(genops.c:1384:class_connect()) connect: client 23f7dc83-f18d-4470-88f4-3dd4c845ced7, cookie 0x2a4915844546a664 00002000:00100000:2.0:1790920489.550120:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 23f7dc83-f18d-4470-88f4-3dd4c845ced7/ffff88eb3f66b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790920489.550155:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790920489.550480:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790920489.550528:0:6689:0:(import.c:65:import_set_state_nolock()) ffff88eb3f66a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790920489.550624:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2351:x1877915951210112:12345-192.168.204.34@tcp:8:lhsmtool_posix.0 Request processed in 622us (11790us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920489.550633:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:1.0:1790920489.556157:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.556486:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951210240 00000100:00100000:2.0:1790920489.556499:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951210240 00000100:00100000:2.0:1790920489.556600:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:2.0:1790920489.556613:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:0:x1877915951210240:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790920489.559257:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790920489.659273:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1790920489.659324:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000100:00100000:3.0:1790920489.660326:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:0:x1877915951210240:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 103706us (104170us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790920489.660343:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:1.0:1790920489.665409:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920489.670870:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951210496 00000100:00100000:0.0:1790920489.670890:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951210496 00000100:00100000:1.0:1790920489.671190:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:1.0:1790920489.671203:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:10451:x1877915951210496:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790920489.671579:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:10451:x1877915951210496:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 377us (6184us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1790920489.671589:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1790920489.676475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920489.676597:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951210752 00000100:00100000:3.0:1790920489.676609:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951210752 00000100:00100000:3.0:1790920489.676677:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:3.0:1790920489.676690:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:10451:x1877915951210752:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790920489.676924:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:10451:x1877915951210752:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 235us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920489.676934:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:1.0:1790920489.681640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.681944:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951210880 00000100:00100000:2.0:1790920489.681958:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951210880 00000100:00100000:1.0:1790920489.682271:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:1.0:1790920489.682284:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:10451:x1877915951210880:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920489.682314:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920489.682344:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a66b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab81 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.682432:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a672 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.682450:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.682465:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920489.682510:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920489.682532:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.682580:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a66b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab81 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.682599:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a672 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab81 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.682608:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920489.682611:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790920489.682616:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d000, rc 0) 00000100:00100000:1.0:1790920489.682715:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:10451:x1877915951210880:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 432us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920489.682723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:1.0:1790920489.687273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920489.687390:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951211008 00000100:00100000:3.0:1790920489.687404:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951211008 00000100:00100000:3.0:1790920489.687482:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:3.0:1790920489.687495:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951211008:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790920489.687522:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920489.687554:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab88 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790920489.687591:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf4729, blocks: 0x1 00010000:00010000:3.0:1790920489.687616:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1790920489.687621:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920489.687633:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.687657:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.687704:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37e00, rc 0) 00000100:00100000:3.0:1790920489.687807:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951211008:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 314us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920489.687815:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:2.0:1790920489.693016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920489.693123:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951211264 00000100:00100000:0.0:1790920489.693138:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951211264 00000100:00100000:0.0:1790920489.693217:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:0.0:1790920489.693229:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:10451:x1877915951211264:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790920489.693397:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:10451:x1877915951211264:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 169us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920489.693405:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:0.0:1790920489.709267:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.709634:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951211392 00000100:00100000:1.0:1790920489.709647:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951211392 00000100:00100000:1.0:1790920489.709727:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:1.0:1790920489.709738:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:10451:x1877915951211392:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920489.709794:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920489.709820:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab8f expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.709862:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.709873:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920489.709878:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920489.709902:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.709947:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.709964:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 7 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920489.709981:0:8267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1877915972209280:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920489.710095:0:8267:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0a998900 going to sleep for 11 seconds 00000100:00100000:1.0:1790920489.715844:0:8267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1877915972209280:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920489.715895:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.715922:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443da00, rc 0) 00000100:00100000:1.0:1790920489.715994:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:10451:x1877915951211392:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 6257us (6743us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920489.716005:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:0.0:1790920489.716702:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.716829:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951211520 00000100:00100000:1.0:1790920489.716839:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951211520 00010000:00010000:1.0:1790920489.716883:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 7 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920489.716916:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:1.0:1790920489.716926:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951211520:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920489.716981:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920489.717011:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 7 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.717025:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 7 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.717054:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546a679 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab88 expref: 7 pid: 6689 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.717070:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920489.717075:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920489.717084:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.717096:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920489.717138:0:8460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920489.717156:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f6a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8460:1877915972209408:192.168.204.34@tcp:105: 00000100:00100000:1.0:1790920489.717241:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0a998900 going to sleep for 11 seconds 00000100:00100000:1.0:1790920489.719203:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f6a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8460:1877915972209408:192.168.204.34@tcp:105: 00010000:00010000:1.0:1790920489.719237:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920489.719331:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951211520:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 2403us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920489.719343:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:0.0:1790920489.721242:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.721370:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951211648 00000100:00100000:1.0:1790920489.721383:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951211648 00002000:00100000:1.0:1790920489.721450:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88eb33ff9f80 x1877915951211648/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:100/0 lens 504/0 e 0 to 0 dl 1790920500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920489.721464:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb33ff9f80 with x1877915951211648 ext(0->8) 00002000:00010000:1.0:1790920489.721471:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb33ff9f80 00000100:00100000:1.0:1790920489.721508:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1790920489.721519:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951211648:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790920489.722462:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951211648:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 934us (1221us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790920489.722475:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00002000:00100000:1.0:1790920489.722487:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88eb33ff9f80 x1877915951211648/t4294967302(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:100/0 lens 504/448 e 0 to 0 dl 1790920500 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920489.722498:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb33ff9f80 with x1877915951211648 ext(0->8) 00002000:00010000:1.0:1790920489.722504:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb33ff9f80 00000100:00100000:0.0:1790920489.733245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920489.736123:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951211776 00000100:00100000:1.0:1790920489.736141:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951211776 00000100:00100000:1.0:1790920489.736223:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:1.0:1790920489.736234:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:10451:x1877915951211776:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790920489.836127:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1790920489.836170:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1790920489.836191:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88ea037849c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1790920489.836197:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88ea01fa2900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88ea03784300 00000020:00080000:0.0:1790920489.836201:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88ea01fa2500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb072f8c00 00000001:00080000:0.0:1790920489.836225:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1790920489.836237:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1790920489.836267:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790920489.836476:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790920489.836616:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790920489.836711:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972209536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790920489.837078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920489.837186:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972209536 00000100:00100000:3.0:1790920489.837198:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972209536 00000100:00100000:3.0:1790920489.837269:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790920489.837279:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1877915972209536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790920489.837315:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00100000:1.0:1790920489.837689:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:10451:x1877915951211776:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 101452us (104455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920489.837699:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00002000:00010000:3.0:1790920489.838827:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abf4727, atime: 0x6abf4727, ctime: 0x6abf4727, blocks: 0x1 00010000:00010000:3.0:1790920489.838845:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.838866:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1790920489.838872:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920489.838880:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.838905:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.838916:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.838925:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.838962:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790920489.839661:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1877915972209536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2376us (2577us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790920489.839688:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1790920489.839818:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920489.839826:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.839836:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920489.839841:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.839853:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.839877:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.839885:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546a687 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.839909:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920489.839911:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920489.839913:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790920489.846957:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb33ff9c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790920489.846980:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972209536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790920489.847004:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920489.847019:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972209664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790920489.847108:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920489.854325:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920489.861702:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972209664 00000100:00100000:2.0:1790920489.861724:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972209664 00000100:00100000:2.0:1790920489.861883:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951211904 00000100:00080000:0.0:1790920489.861909:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920489.862099:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951211904 00000100:00100000:2.0:1790920489.862145:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790920489.862157:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972209664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790920489.862454:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:0.0:1790920489.862467:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951211904:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00002000:00010000:2.0:1790920489.862588:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790920489.862593:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790920489 00002000:00010000:2.0:1790920489.862596:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790920489.862599:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790920489 -> 1790920489 00002000:00010000:2.0:1790920489.862601:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790920489.862876:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877915972209664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 720us (15768us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790920489.862884:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1790920489.874604:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb33ff9880/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790920489.874636:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972209664:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1790920489.987480:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1790920489.987513:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1790920489.987553:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951211904:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 125082us (133231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920489.987567:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:1.0:1790920489.993672:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920489.998214:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951212160 00000100:00100000:3.0:1790920489.998237:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951212160 00000100:00100000:3.0:1790920489.998448:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:3.0:1790920489.998459:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:10451:x1877915951212160:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790920489.998526:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920489.998561:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a672 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab81 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.998585:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:3.0:1790920489.998590:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920489.998626:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.998642:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920489.998654:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920489.999008:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096a78922 reply state 000000003168682e transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920489.999020:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790920489.999152:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:10451:x1877915951212160:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 694us (5507us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1790920489.999161:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 81 00010000:00010000:2.0:1790920490.006042:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.006063:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.006073:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.006080:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920490.006099:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.006110:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.006134:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920490.006138:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920490.006145:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.006163:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546a68e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920490.010390:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920490.010485:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951212288 00000100:00100000:2.0:1790920490.010502:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951212288 00000100:00100000:2.0:1790920490.010578:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:2.0:1790920490.010591:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951212288:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790920490.010997:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790920490.011002:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790920489 -> 1790920489 00002000:00010000:2.0:1790920490.011004:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790920487 00002000:00010000:2.0:1790920490.011007:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790920489 -> 1790920489 00002000:00010000:2.0:1790920490.011009:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790920490.011090:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951212288:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 500us (715us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790920490.011099:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:0.0:1790920490.027468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920490.027567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951212544 00000100:00100000:3.0:1790920490.027581:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951212544 00000100:00100000:3.0:1790920490.027682:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:3.0:1790920490.027706:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:10451:x1877915951212544:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790920490.027826:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.027865:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.027876:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.027924:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.027939:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 13 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920490.027955:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972209792:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920490.028066:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949240 going to sleep for 11 seconds 00000100:00080000:0.0:1790920490.028206:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790920490.034020:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920490.038331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920490.038436:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951212672 00000100:00100000:2.0:1790920490.038450:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951212672 00010000:00010000:2.0:1790920490.038520:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920490.038599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:2.0:1790920490.038612:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2355:x1877915951212672:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920490.038634:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920490.038644:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.038671:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 14 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.038702:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920490.038708:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.038720:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.038730:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920490.038796:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920490.038874:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2355:x1877915951212672:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 264us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920490.038883:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00010000:00010000:3.0:1790920490.047336:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a64f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab73 expref: 13 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920490.047369:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972209792:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920490.047402:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048555:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048572:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048618:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048650:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048671:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048678:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.048691:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048700:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048722:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:3.0:1790920490.048725:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790920490.048732:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.048738:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a695 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920490.048882:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:10451:x1877915951212544:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 21177us (21428us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790920490.048911:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:1.0:1790920490.056366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920490.056469:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951212800 00000100:00100000:3.0:1790920490.056486:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951212800 00000100:00100000:3.0:1790920490.056575:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:3.0:1790920490.056587:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951212800:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790920490.056652:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.056722:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.056733:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790920490.056738:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920490.056769:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.056821:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.056839:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 7 pid: 8267 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920490.056857:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1877915972209920:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920490.056983:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949240 going to sleep for 11 seconds 00000100:00100000:1.0:1790920490.075396:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920490.077366:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1877915972209920:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920490.077414:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920490.077786:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951212928 00000100:00100000:1.0:1790920490.077799:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951212928 00010000:00010000:1.0:1790920490.077851:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 8 pid: 8267 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920490.077899:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:1.0:1790920490.077911:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951212928:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920490.077931:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920490.077961:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 8 pid: 8267 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.077977:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 8 pid: 8267 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.078006:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c7e99d/0x2a4915844546a680 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab8f expref: 8 pid: 8267 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.078047:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920490.078052:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920490.078059:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.078070:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.078100:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920490.078182:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951212928:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 272us (2801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920490.078190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00010000:00010000:1.0:1790920490.084095:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084120:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084172:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084183:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084192:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084211:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920490.084217:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084226:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084252:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.084261:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3674e84/0x2a4915844546a69c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920490.086549:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951212800:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 29952us (30186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920490.086562:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:3.0:1790920490.098460:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920490.098785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951213184 00000100:00100000:0.0:1790920490.098799:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951213184 00000100:00100000:0.0:1790920490.098897:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:0.0:1790920490.098911:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:10451:x1877915951213184:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790920490.099028:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.099051:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.099065:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.099385:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.099400:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.099410:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.099465:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.099502:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 13 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920490.099519:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972210048:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920490.099675:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd480 going to sleep for 11 seconds 00000100:00100000:2.0:1790920490.114551:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920490.114692:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951213312 00000100:00100000:1.0:1790920490.114705:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951213312 00010000:00010000:1.0:1790920490.114787:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 14 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920490.114834:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:1.0:1790920490.114846:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2354:x1877915951213312:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920490.114864:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920490.114881:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 14 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.114896:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 14 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.114927:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920490.114933:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.114946:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.114954:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.114979:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920490.115050:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2354:x1877915951213312:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 206us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920490.115059:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00010000:00010000:0.0:1790920490.116228:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546a65d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab7a expref: 13 pid: 5847 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920490.116258:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972210048:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920490.116299:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.116311:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.116317:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920490.116580:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1790920490.116826:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1790920490.116879:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1790920490.116989:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972210176:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790920490.117065:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920490.117101:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb1091cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790920490.117135:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972210176 00000100:00100000:0.0:1790920490.117141:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972210176 00000100:00100000:0.0:1790920490.117192:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790920490.117218:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877915972210176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790920490.117302:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877915972210176:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920490.117310:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790920490.117351:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1790920490.117358:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb33ff9880, transno 4294967303 00000100:00100000:0.0:1790920490.117371:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972210176:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1790920490.117942:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1790920490.118013:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972210304:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790920490.118054:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920490.118084:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790920490.118321:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972210304 00000100:00100000:0.0:1790920490.118327:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972210304 00000100:00100000:0.0:1790920490.118363:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920490.118370:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877915972210304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790920490.118545:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1877915972210304:12345-0@lo:1000:mdt00_001.0 Request processed in 174us (489us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790920490.118553:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920490.118596:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972210304:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1790920490.118635:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118646:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118655:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118684:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920490.118689:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118699:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118721:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920490.118724:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790920490.118732:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118739:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031600/0x2a4915844546a6aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118809:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118816:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118822:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118827:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920490.118830:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118836:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118854:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f900) 00010000:00010000:0.0:1790920490.118856:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790920490.118859:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118865:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00030c00/0x2a4915844546a5d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118890:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118906:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 16 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118916:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.118946:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 16 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.122453:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 16 pid: 11700 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920490.122478:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972210432:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920490.122601:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb086cbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920490.129513:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972210432:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920490.129556:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920490.146987:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920490.147538:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951213440 00000100:00100000:1.0:1790920490.147552:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951213440 00010000:00010000:1.0:1790920490.147610:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 17 pid: 11700 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920490.147731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:1.0:1790920490.147766:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:2355:x1877915951213440:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920490.147788:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920490.147797:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 17 pid: 11700 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.147826:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 17 pid: 11700 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.147857:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a5f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab5e expref: 17 pid: 11700 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.147873:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f900) 00010000:00010000:1.0:1790920490.147879:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.147891:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.147900:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.147935:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920490.148012:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:2355:x1877915951213440:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 270us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920490.148020:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00010000:00010000:3.0:1790920490.148093:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148103:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148118:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148125:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148143:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148149:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.148155:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148164:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148174:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f900) 00010000:00010000:3.0:1790920490.148177:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920490.148182:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148189:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a6b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148202:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148208:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148214:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148219:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.148222:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148241:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148250:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb0856f900) 00010000:00010000:3.0:1790920490.148252:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790920490.148255:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.148261:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031c00/0x2a4915844546a6a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790920490.149853:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790920490.149866:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790920490.149914:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790920490.149920:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790920490.150031:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:10451:x1877915951213184:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 51116us (51578us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1790920490.150044:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000020:00080000:3.0:1790920490.150050:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790920490.160106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920490.160185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951213696 00000100:00100000:1.0:1790920490.160200:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951213696 00000100:00100000:1.0:1790920490.161477:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1790920490.161498:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:10451:x1877915951213696:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790920490.165959:0:5848:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790920490.166237:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:1.0:1790920490.168482:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.168523:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.168539:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.168551:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.168558:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.168565:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.168595:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920490.169846:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920490.169863:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.169876:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920490.169880:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.169892:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.169912:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88eb01486900) 00010000:00010000:0.0:1790920490.169916:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790920490.169922:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.169929:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a6b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.169959:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920490.169961:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920490.169963:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920490.170111:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:10451:x1877915951213696:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 8610us (10007us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790920490.170126:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000020:00080000:1.0:1790920490.170136:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1790920490.562943:0:12012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790920490.562952:0:12012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920490.563009:0:12012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790920490.563017:0:12012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790920490.714199:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920490.714327:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951213952 00000100:00100000:0.0:1790920490.714351:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951213952 00000100:00100000:0.0:1790920490.714459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:0.0:1790920490.714475:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:10461:x1877915951213952:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920490.714530:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920490.714574:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a6bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab96 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.714810:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546a6c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.714833:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546a6c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.714853:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546a6c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920490.714871:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790920490.715062:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a6bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab96 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.715086:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546a6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab96 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.715096:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920490.715100:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790920490.715104:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52800, rc 0) 00000100:00100000:0.0:1790920490.715226:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10461:x1877915951213952:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 756us (1036us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1790920490.715235:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:2.0:1790920490.727101:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920490.729326:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951214080 00000100:00100000:3.0:1790920490.729349:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951214080 00000100:00100000:3.0:1790920490.729450:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:3.0:1790920490.729463:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10461:x1877915951214080:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:3.0:1790920490.729566:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.729588:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.729619:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.729638:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.729659:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.729668:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730008:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730017:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730025:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920490.730078:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730094:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730102:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730110:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730126:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.730131:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730140:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730155:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920490.730158:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920490.730164:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730170:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730183:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730189:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730195:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730199:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.730201:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730207:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730226:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb04d19000) 00010000:00010000:3.0:1790920490.730229:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920490.730232:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730237:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730254:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730261:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730266:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730271:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.730274:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730279:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730287:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19800) 00010000:00010000:3.0:1790920490.730289:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920490.730292:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.730297:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920490.730434:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10461:x1877915951214080:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 970us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920490.730443:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:3.0:1790920490.791482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920490.791529:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951214336 00000100:00100000:3.0:1790920490.791543:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951214336 00000100:00100000:3.0:1790920490.791620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:3.0:1790920490.791633:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10464:x1877915951214336:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920490.791675:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920490.791703:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edab9d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.791832:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.791851:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.791866:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.791883:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.791891:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.791898:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792255:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792264:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792272:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920490.792286:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790920490.792791:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792801:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792809:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792816:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.792821:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792831:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792846:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920490.792849:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920490.792855:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792871:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a6f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792888:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792893:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792899:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792904:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.792907:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792914:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792921:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb04d19800) 00010000:00010000:3.0:1790920490.792924:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920490.792927:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792933:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a6f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.792990:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a6e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.793009:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.793025:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920490.793027:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920490.793030:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37800, rc 0) 00000100:00100000:3.0:1790920490.793130:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10464:x1877915951214336:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1499us (1662us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790920490.793140:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:2.0:1790920490.799669:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920490.799780:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951214464 00000100:00100000:0.0:1790920490.799795:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951214464 00000100:00100000:0.0:1790920490.799883:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:0.0:1790920490.799904:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10464:x1877915951214464:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:0.0:1790920490.799997:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800018:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800032:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800065:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800073:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800080:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800087:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920490.800093:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800101:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800114:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:0.0:1790920490.800118:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920490.800124:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.800130:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a70c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920490.800233:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10464:x1877915951214464:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 332us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920490.800241:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:2.0:1790920490.817420:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920490.817505:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951214720 00000100:00100000:1.0:1790920490.817521:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951214720 00000100:00100000:1.0:1790920490.817631:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1790920490.817653:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10464:x1877915951214720:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920490.817999:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:10464:x1877915951214720:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 357us (591us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1790920490.818008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:0.0:1790920490.872816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920490.872940:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951214976 00000100:00100000:3.0:1790920490.872954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951214976 00000100:00100000:3.0:1790920490.873031:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:3.0:1790920490.873043:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:9992:x1877915951214976:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1790920490.873074:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920490.873100:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a713 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaba4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.873235:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.873253:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.873264:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.873448:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.873466:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 23 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920490.873503:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe11880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972210560:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920490.873652:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb059499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920490.886149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920490.886813:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951215104 00000100:00100000:1.0:1790920490.886828:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951215104 00010000:00010000:1.0:1790920490.886892:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 24 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920490.886956:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:1.0:1790920490.886968:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:2354:x1877915951215104:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920490.886987:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920490.886995:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 24 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.887013:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 24 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.887045:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:1.0:1790920490.887051:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.887064:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.887073:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920490.887099:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920490.887176:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:2354:x1877915951215104:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 210us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920490.887185:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00010000:00010000:3.0:1790920490.888282:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a6fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab9d expref: 23 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920490.888393:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe11880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972210560:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920490.888422:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.888434:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.888440:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920490.888543:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790920490.889682:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546a713 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.889720:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.889731:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920490.889735:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790920490.889739:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37400, rc 0) 00000100:00100000:3.0:1790920490.889858:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:9992:x1877915951214976:12345-192.168.204.34@tcp:101:bash.0 Request processed in 16815us (17113us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1790920490.889891:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:1.0:1790920490.897949:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920490.898289:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951215360 00000100:00100000:0.0:1790920490.898302:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951215360 00000100:00100000:0.0:1790920490.898385:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:0.0:1790920490.898398:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:9992:x1877915951215360:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:0.0:1790920490.899166:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.899192:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.899208:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920490.899284:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:0.0:1790920490.899975:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa168e05 reply state 0000000040b607da transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920490.899990:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790920490.900087:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:0.0:1790920490.900448:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:9992:x1877915951215360:12345-192.168.204.34@tcp:36:bash.0 Request processed in 2046us (2509us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1790920490.900626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 89 00000020:00080000:0.0:1790920490.900634:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790920490.907166:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920490.907276:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951215488 00000100:00100000:0.0:1790920490.907317:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951215488 00010000:00010000:3.0:1790920490.907480:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.907496:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.907505:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.907512:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920490.907519:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.907527:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.907549:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920490.907552:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920490.907558:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.907565:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a728 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920490.907698:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 90 00000100:00100000:0.0:1790920490.907721:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:9992:x1877915951215488:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920490.907795:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920490.907823:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546a72f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabab expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.907914:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546a72f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabab expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.907930:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546a72f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabab expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920490.907952:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:0.0:1790920490.907955:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790920490.907957:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52c00, rc 0) 00000100:00100000:0.0:1790920490.908030:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:9992:x1877915951215488:12345-192.168.204.34@tcp:101:bash.0 Request processed in 312us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920490.908037:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 90 00000100:00100000:2.0:1790920490.911435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920490.911535:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951215616 00000100:00100000:3.0:1790920490.911549:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951215616 00000100:00100000:3.0:1790920490.911624:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:3.0:1790920490.911636:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:9992:x1877915951215616:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1790920490.911679:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920490.911726:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabb2 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790920490.911794:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abf4729, atime: 0x6abf4727, ctime: 0x6abf4729, blocks: 0xb 00010000:00010000:3.0:1790920490.911826:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1790920490.911832:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920490.911842:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.911865:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920490.911882:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36e00, rc 0) 00000100:00100000:3.0:1790920490.911953:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:9992:x1877915951215616:12345-192.168.204.34@tcp:101:bash.0 Request processed in 318us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920490.911961:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:2.0:1790920490.916599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920490.917948:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951215744 00000100:00100000:1.0:1790920490.917972:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951215744 00002000:00010000:1.0:1790920490.918052:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1790920490.918059:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3af2e680 with x1877915951215744 ext(0->18446744073709551615) 00002000:00010000:1.0:1790920490.918081:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3af2e680. 00000100:00100000:1.0:1790920490.918137:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:1.0:1790920490.918150:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2352:x1877915951215744:12345-192.168.204.34@tcp:10:bash.0 00002000:00010000:1.0:1790920490.919159:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790920490.919168:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790920489 -> 1790920491 00002000:00010000:1.0:1790920490.919172:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790920487 -> 1790920487 00002000:00010000:1.0:1790920490.919174:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790920489 -> 1790920491 00002000:00010000:1.0:1790920490.919177:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790920490.919714:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2352:x1877915951215744:12345-192.168.204.34@tcp:10:bash.0 Request processed in 1560us (3127us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790920490.919726:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00002000:00010000:1.0:1790920490.919732:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1790920490.919736:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3af2e680 with x1877915951215744 ext(0->18446744073709551615) 00002000:00010000:1.0:1790920490.919765:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3af2e680. 00000100:00100000:2.0:1790920491.002920:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.003097:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951215872 00000100:00100000:3.0:1790920491.003110:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951215872 00000100:00100000:3.0:1790920491.003190:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:3.0:1790920491.003202:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:10478:x1877915951215872:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:3.0:1790920491.003346:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003371:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003386:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003432:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003441:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003448:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003853:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003864:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003872:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920491.003930:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003944:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003951:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003958:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003966:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920491.003971:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.003988:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004004:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920491.004007:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920491.004014:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004021:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a73d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004036:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004042:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004048:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004054:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920491.004057:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004063:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004071:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb04d19c00) 00010000:00010000:3.0:1790920491.004074:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920491.004076:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004091:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a744 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004111:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004118:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004125:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004130:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920491.004134:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004141:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004149:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920491.004152:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920491.004155:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.004161:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a74b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.004275:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:10478:x1877915951215872:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 1071us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920491.004285:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 91 00010000:00010000:1.0:1790920491.049419:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920491.055210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.055536:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951216128 00000100:00100000:1.0:1790920491.055551:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951216128 00000100:00100000:1.0:1790920491.055628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:1.0:1790920491.055652:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:10481:x1877915951216128:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920491.055840:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920491.055868:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a752 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabb9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.055981:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.055999:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.056012:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.056027:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.056035:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.056042:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.056865:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.056882:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.056891:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920491.056905:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790920491.057035:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057044:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057063:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057069:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920491.057074:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057083:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057097:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920491.057100:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920491.057105:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057112:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a759 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057130:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057136:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057142:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057147:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443dc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920491.057150:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057165:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057173:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486000) 00010000:00010000:1.0:1790920491.057175:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920491.057178:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057183:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.057239:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a752 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb9 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.058151:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb9 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.058165:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:1.0:1790920491.058167:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790920491.058171:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c000, rc 0) 00000100:00100000:1.0:1790920491.058288:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:10481:x1877915951216128:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2649us (3093us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790920491.058301:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:2.0:1790920491.062123:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.062230:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951216256 00000100:00100000:3.0:1790920491.062243:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951216256 00000100:00100000:3.0:1790920491.062469:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:3.0:1790920491.062482:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:10481:x1877915951216256:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:3.0:1790920491.062576:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.062598:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.062608:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.062674:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.062690:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 29 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.062706:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972210688:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920491.062860:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb059499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920491.066798:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.066893:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951216512 00000100:00100000:1.0:1790920491.066907:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951216512 00000100:00100000:1.0:1790920491.066982:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:1.0:1790920491.066994:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:5592:x1877915951216512:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790920491.067523:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:5592:x1877915951216512:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 529us (776us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790920491.067533:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:2.0:1790920491.067833:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972210688:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920491.067867:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920491.070908:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.071113:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951216640 00000100:00100000:1.0:1790920491.071128:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951216640 00010000:00010000:1.0:1790920491.071184:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 31 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920491.071235:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:1.0:1790920491.071248:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:2354:x1877915951216640:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920491.071284:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920491.071292:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 31 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.071318:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 31 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.071347:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a71a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaba4 expref: 31 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.071368:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:1.0:1790920491.071374:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.071385:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.071394:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.071456:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920491.071536:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:2354:x1877915951216640:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 289us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920491.071545:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00010000:00010000:3.0:1790920491.071715:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071725:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071810:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071819:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071827:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071834:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920491.071839:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071848:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071857:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920491.071861:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790920491.071865:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.071871:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a775 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.071920:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:10481:x1877915951216256:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 9440us (9811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920491.071930:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:0.0:1790920491.078015:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.078113:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951216896 00000100:00100000:1.0:1790920491.078127:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951216896 00000100:00100000:1.0:1790920491.078197:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:1.0:1790920491.078210:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:10481:x1877915951216896:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920491.078568:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:10481:x1877915951216896:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 359us (569us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1790920491.078577:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:0.0:1790920491.227704:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.233020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951217152 00000100:00100000:3.0:1790920491.233045:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951217152 00000100:00100000:3.0:1790920491.233157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:3.0:1790920491.233191:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:10492:x1877915951217152:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1790920491.233228:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920491.233269:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a77c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabc0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233383:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233402:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233417:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233434:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233441:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233449:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233877:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233890:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.233898:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920491.233923:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1790920491.234046:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234055:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234063:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234070:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920491.234075:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234084:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234099:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920491.234102:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920491.234109:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234116:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546a783 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234133:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234140:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234159:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234165:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920491.234168:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234175:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234183:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb04d19c00) 00010000:00010000:3.0:1790920491.234186:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920491.234189:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234196:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546a78a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234254:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546a77c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc0 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234271:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc0 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.234278:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:3.0:1790920491.234281:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920491.234284:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36400, rc 0) 00000100:00100000:3.0:1790920491.234388:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:10492:x1877915951217152:12345-192.168.204.34@tcp:101:cat.0 Request processed in 1199us (6698us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790920491.234408:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:2.0:1790920491.260707:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.260848:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951217408 00000100:00100000:1.0:1790920491.260863:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951217408 00000100:00100000:1.0:1790920491.260938:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:1.0:1790920491.260951:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:10492:x1877915951217408:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:1.0:1790920491.261291:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:10492:x1877915951217408:12345-192.168.204.34@tcp:35:cat.0 Request processed in 341us (598us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1790920491.261300:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:0.0:1790920491.297079:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.299814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951217664 00000100:00100000:1.0:1790920491.299842:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951217664 00000100:00100000:1.0:1790920491.299941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:1.0:1790920491.299954:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:10493:x1877915951217664:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:1.0:1790920491.300040:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790920491.300079:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546a791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc0 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300136:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546a767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb9 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300152:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546a72f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabab expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300165:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb04d19000) 00010000:00010000:1.0:1790920491.300180:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920491.300212:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300263:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300279:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300299:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300307:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300315:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300674:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300684:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.300697:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920491.308422:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1790920491.308439:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333474691338ns, next at 334474687151ns, rc = 0 00010000:00010000:0.0:1790920491.308542:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308561:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308588:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308600:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308608:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308616:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308651:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920491.308678:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308687:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308694:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.308700:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920491.308703:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920491.308709:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308724:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.308728:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308740:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb01486800) 00010000:00010000:0.0:1790920491.308782:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790920491.308795:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920491.308798:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.308805:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308811:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546a7ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.308823:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308843:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.308845:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88eb01486800) 00010000:00010000:3.0:1790920491.308857:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790920491.308866:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308867:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.308893:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546a7b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308898:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308916:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443da00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920491.308921:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308929:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308942:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920491.308944:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920491.308946:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920491.308949:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920491.308956:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920491.308957:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.308968:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546a79f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920491.308982:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3d904ee reply state 0000000016bb11ce transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920491.309003:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790920491.309378:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:10493:x1877915951217664:12345-192.168.204.34@tcp:36:rm.0 Request processed in 9142us (12031us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790920491.309389:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 95 00010000:00010000:2.0:1790920491.318033:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.318061:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.318070:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.318079:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443dc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920491.318085:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.318094:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.318117:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486000) 00010000:00010000:2.0:1790920491.318143:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920491.318151:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.318158:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546a7a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920491.403595:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.403969:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951217920 00000100:00100000:3.0:1790920491.403980:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951217920 00000100:00100000:2.0:1790920491.404175:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 96 00000100:00100000:2.0:1790920491.404187:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:10499:x1877915951217920:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1790920491.404211:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920491.404232:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a7bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabc7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.404455:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.404471:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.404481:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.404493:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.404511:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.404516:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920491.405069:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1790920491.405316:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405327:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405334:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405364:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405370:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405376:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405382:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920491.405386:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405393:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405404:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:2.0:1790920491.405407:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920491.405411:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405417:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a7c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920491.405438:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054b3ef24 reply state 00000000999930b4 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920491.405446:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790920491.405472:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a7bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405484:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.405490:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:2.0:1790920491.405492:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920491.405494:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a600, rc 0) 00000100:00100000:2.0:1790920491.405621:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:10499:x1877915951217920:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1436us (2034us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790920491.405628:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 96 00010000:00010000:3.0:1790920491.423024:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.423044:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.423068:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.423074:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920491.423078:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.423095:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.423112:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb2cb2cc00) 00010000:00010000:3.0:1790920491.423115:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920491.423119:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.423124:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546a7c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920491.425505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.425862:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951218048 00000100:00100000:1.0:1790920491.425873:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951218048 00000100:00100000:1.0:1790920491.425955:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:1.0:1790920491.425967:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951218048:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920491.425987:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920491.426011:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabce expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790920491.426040:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790920491.426062:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1790920491.426066:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920491.426077:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.426097:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.426110:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c000, rc 0) 00000100:00100000:1.0:1790920491.426176:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951218048:12345-192.168.204.34@tcp:101:bash.0 Request processed in 211us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920491.426185:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00080000:0.0:1790920491.426272:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790920491.432275:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.432361:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951218176 00000100:00100000:3.0:1790920491.432371:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951218176 00000100:00100000:3.0:1790920491.432421:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:3.0:1790920491.432428:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:10499:x1877915951218176:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1790920491.432444:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920491.432460:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabd5 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.432487:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.432512:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920491.432516:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920491.432522:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.432557:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.432569:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 9 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.432580:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1877915972210816:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920491.432684:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920491.438846:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.439202:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951218304 00000100:00100000:1.0:1790920491.439212:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951218304 00010000:00010000:1.0:1790920491.439277:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 10 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920491.439324:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1790920491.439332:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2354:x1877915951218304:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920491.439347:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920491.439369:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 10 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.439383:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 10 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.439408:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920491.439412:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920491.439420:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.439430:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.439463:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920491.439477:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1877915972210944:192.168.204.34@tcp:105: 00000100:00100000:1.0:1790920491.439542:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd56c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790920491.439648:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ba88d07/0x2a4915844546a7de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabce expref: 10 pid: 6689 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920491.439676:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1877915972210816:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920491.439702:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.439724:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36600, rc 0) 00000100:00100000:2.0:1790920491.439811:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:10499:x1877915951218176:12345-192.168.204.34@tcp:101:bash.0 Request processed in 7382us (7545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920491.439830:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:1.0:1790920491.446294:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1877915972210944:192.168.204.34@tcp:105: 00010000:00010000:1.0:1790920491.446335:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920491.446401:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951218304:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 7068us (7655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920491.446414:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1790920491.448901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.450355:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951218560 00000100:00100000:3.0:1790920491.450371:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951218560 00000100:00100000:3.0:1790920491.450526:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:3.0:1790920491.450537:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:10499:x1877915951218560:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:3.0:1790920491.451052:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:10499:x1877915951218560:12345-192.168.204.34@tcp:35:bash.0 Request processed in 515us (2157us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1790920491.451060:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1790920491.738858:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.738979:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951218688 00000100:00100000:3.0:1790920491.738994:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951218688 00000100:00100000:3.0:1790920491.739071:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:3.0:1790920491.739111:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:10515:x1877915951218688:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920491.739146:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920491.739175:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546a7ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabdc expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.739273:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a7f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.739291:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.739304:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920491.739350:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790920491.739355:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920491.739376:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.739407:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546a7ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabdc expref: 36 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.739430:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabdc expref: 35 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.739439:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920491.739442:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920491.739447:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36a00, rc 0) 00000100:00100000:3.0:1790920491.739528:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:10515:x1877915951218688:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 421us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920491.739545:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:2.0:1790920491.752330:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.752418:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951218944 00000100:00100000:1.0:1790920491.752437:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951218944 00000100:00100000:1.0:1790920491.752518:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:1.0:1790920491.752533:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:10515:x1877915951218944:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920491.752565:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920491.752594:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a7fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabe3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.753380:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.753403:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.753420:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920491.753437:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790920491.753655:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a7fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabe3 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.753692:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabe3 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.755083:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:1.0:1790920491.755086:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920491.755091:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d000, rc 0) 00000100:00100000:1.0:1790920491.755983:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:10515:x1877915951218944:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 3440us (3648us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1790920491.755997:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:0.0:1790920491.769479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.770795:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951219200 00000100:00100000:3.0:1790920491.770816:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951219200 00000100:00100000:3.0:1790920491.770910:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:3.0:1790920491.770921:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:10515:x1877915951219200:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920491.770947:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920491.770970:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546a80f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabea expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.771094:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a816 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.771113:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.771125:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920491.771138:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790920491.771271:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546a80f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabea expref: 40 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.771296:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a816 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabea expref: 39 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.771306:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:3.0:1790920491.771309:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790920491.771313:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37200, rc 0) 00000100:00100000:3.0:1790920491.771498:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:10515:x1877915951219200:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 579us (2035us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1790920491.771505:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:0.0:1790920491.772534:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.772585:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951219328 00000100:00100000:1.0:1790920491.772592:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951219328 00000100:00100000:1.0:1790920491.772657:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1790920491.772666:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:2354:x1877915951219328:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920491.772679:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920491.772699:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabe3 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.772716:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:1.0:1790920491.772720:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920491.772957:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:2354:x1877915951219328:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 291us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920491.772964:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:2.0:1790920491.788317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.788573:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951219456 00000100:00100000:3.0:1790920491.788583:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951219456 00000100:00100000:3.0:1790920491.788657:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:3.0:1790920491.788666:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951219456:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:3.0:1790920491.788712:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.788730:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.788738:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920491.788742:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920491.788866:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.788907:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.788920:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 8 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.788933:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877915972211072:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920491.789030:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05949a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790920491.792326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920491.792416:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951219584 00000100:00100000:2.0:1790920491.792427:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951219584 00000100:00100000:3.0:1790920491.792466:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877915972211072:192.168.204.34@tcp:104: 00002000:00100000:2.0:1790920491.792492:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88eb41c61180 x1877915951219584/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:102/0 lens 504/0 e 0 to 0 dl 1790920502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790920491.792506:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790920491.792506:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb41c61180 with x1877915951219584 ext(0->8) 00010000:00010000:2.0:1790920491.792518:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 9 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.792537:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 9 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790920491.792546:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb41c61180 00000100:00100000:2.0:1790920491.792652:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:2.0:1790920491.792662:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2354:x1877915951219584:12345-192.168.204.34@tcp:4:lfs.0 00000100:00100000:2.0:1790920491.793162:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:2354:x1877915951219584:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 500us (841us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790920491.793176:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00002000:00100000:2.0:1790920491.793185:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88eb41c61180 x1877915951219584/t4294967302(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:102/0 lens 504/448 e 0 to 0 dl 1790920502 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790920491.793194:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb41c61180 with x1877915951219584 ext(0->8) 00010000:00010000:2.0:1790920491.793201:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 11 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920491.793219:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 11 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790920491.793227:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb41c61180 00000100:00100000:0.0:1790920491.796226:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.796354:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951219712 00000100:00100000:3.0:1790920491.796364:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951219712 00010000:00010000:3.0:1790920491.796407:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 11 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.796451:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:3.0:1790920491.796568:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:2353:x1877915951219712:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920491.796582:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790920491.796601:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790920491.796603:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790920491 00002000:00010000:3.0:1790920491.796604:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790920492 00002000:00010000:3.0:1790920491.796606:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790920491 00010000:00010000:3.0:1790920491.796610:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 11 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.796621:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 11 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.796719:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b1d23c7/0x2a4915844546a7e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabd5 expref: 11 pid: 6688 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.796733:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920491.796808:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920491.796815:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.796825:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.796855:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920491.796882:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.796892:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.796919:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2353:x1877915951219712:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 355us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920491.796925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00010000:00010000:1.0:1790920491.796930:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.796937:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.796946:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.796953:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920491.796957:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.796967:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.796978:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.796986:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3674e84/0x2a4915844546a824 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920491.797033:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951219456:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 8368us (8725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920491.797041:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:3.0:1790920491.801317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.801445:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951219968 00000100:00100000:1.0:1790920491.801456:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951219968 00000100:00100000:1.0:1790920491.801555:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:1.0:1790920491.801566:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:10515:x1877915951219968:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:1.0:1790920491.801648:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a816 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabea expref: 38 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920491.801944:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1790920491.802493:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1790920491.803009:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:1.0:1790920491.803067:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.803086:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.803094:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.803130:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920491.803146:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 42 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920491.803161:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f6b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972211200:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920491.803362:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920491.809553:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920491.809722:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951220096 00000100:00100000:1.0:1790920491.809723:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f6b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972211200:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920491.809731:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951220096 00010000:00010000:1.0:1790920491.809794:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.809804:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 43 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920491.809839:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:3.0:1790920491.809848:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:2355:x1877915951220096:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920491.809864:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920491.809870:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 43 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.809883:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 43 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.809905:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546a7d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabc7 expref: 43 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.809934:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:3.0:1790920491.809938:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.809947:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.809955:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920491.809975:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920491.810068:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+42:2355:x1877915951220096:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 221us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920491.810076:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00010000:00010000:0.0:1790920491.810157:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.810166:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920491.810346:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1790920491.810560:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790920491.810778:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c61500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972211328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920491.810833:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920491.810920:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2180 going to sleep for 11 seconds 00000100:00100000:2.0:1790920491.810964:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972211328 00000100:00100000:2.0:1790920491.810969:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972211328 00000100:00100000:2.0:1790920491.811062:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920491.811070:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1877915972211328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790920491.811149:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1877915972211328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920491.811156:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790920491.811345:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c61500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972211328:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1790920491.813678:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1790920491.815448:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1790920491.815581:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af2f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972211456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790920491.815666:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920491.815709:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f1000 going to sleep for 11 seconds 00000100:00100000:3.0:1790920491.816734:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972211456 00000100:00100000:3.0:1790920491.816777:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972211456 00000100:00100000:3.0:1790920491.816835:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790920491.816845:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1877915972211456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790920491.817127:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5849:x1877915972211456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 282us (1460us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790920491.817134:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790920491.817244:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af2f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972211456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790920491.817318:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1790920491.817383:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.817394:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.817403:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.817409:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920491.817414:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.817422:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.817438:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:0.0:1790920491.817441:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790920491.817445:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.817452:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546a82b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790920491.817680:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790920491.817830:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1790920491.817842:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333984094348ns, next at 334984091400ns, rc = 0 00000001:00080000:0.0:1790920491.817849:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1790920491.817885:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb2cb2c900) 00010000:00010000:0.0:1790920491.817888:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790920491.817896:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546a816 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabea expref: 46 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920491.818020:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:10515:x1877915951219968:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 16455us (16713us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1790920491.818029:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000020:00080000:0.0:1790920491.818032:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790920491.827104:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920491.827203:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951220224 00000100:00100000:0.0:1790920491.827227:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951220224 00000100:00100000:0.0:1790920491.827525:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:0.0:1790920491.827536:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:10515:x1877915951220224:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920491.827837:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920491.827865:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a832 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabf1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.827932:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabf1 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.827948:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabf1 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.827966:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920491.827969:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790920491.827972:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52400, rc 0) 00000100:00100000:0.0:1790920491.828085:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+46:10515:x1877915951220224:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 550us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920491.828091:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:3.0:1790920491.847159:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920491.847454:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951220480 00000100:00100000:1.0:1790920491.847465:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951220480 00000100:00100000:1.0:1790920491.847527:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:1.0:1790920491.847538:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+46:10515:x1877915951220480:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920491.847836:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:10515:x1877915951220480:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 299us (688us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1790920491.847844:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:2.0:1790920491.979538:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920491.979682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951220608 00000100:00100000:0.0:1790920491.979697:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951220608 00000100:00100000:0.0:1790920491.979832:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:0.0:1790920491.979844:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:10525:x1877915951220608:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:0.0:1790920491.979950:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.979972:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.979988:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980006:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980014:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980021:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980264:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980274:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980282:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920491.980330:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980345:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980359:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980367:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980374:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920491.980379:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980388:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980401:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920491.980404:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920491.980409:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980416:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a839 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980433:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980439:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980445:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980450:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920491.980735:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980743:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980814:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb0856fd00) 00010000:00010000:0.0:1790920491.980818:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920491.980822:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980828:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a840 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980848:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980855:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980861:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980866:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920491.980870:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980876:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980884:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920491.980886:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920491.980897:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920491.980903:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920491.981203:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:10525:x1877915951220608:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 1358us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920491.981213:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:2.0:1790920492.054608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920492.054783:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951220864 00000100:00100000:1.0:1790920492.054798:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951220864 00000100:00100000:1.0:1790920492.054902:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:1.0:1790920492.054916:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:10528:x1877915951220864:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920492.054945:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920492.054975:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a84e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabf8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790920492.055250:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790920492.055344:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055364:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055379:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055421:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055429:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055437:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055600:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055610:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.055618:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920492.055641:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790920492.056945:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.056964:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.056992:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.056999:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443cc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920492.057005:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057014:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057035:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:3.0:1790920492.057039:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920492.057045:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057052:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546a855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057089:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057096:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057103:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057108:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ce00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920492.057111:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057129:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057138:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486900) 00010000:00010000:3.0:1790920492.057141:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920492.057144:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057150:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546a85c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057218:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546a84e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabf8 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057235:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabf8 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.057373:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:3.0:1790920492.057377:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920492.057380:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c400, rc 0) 00000100:00100000:3.0:1790920492.057690:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:10528:x1877915951220864:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2775us (3096us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790920492.057701:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:2.0:1790920492.060950:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920492.061043:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951220992 00000100:00100000:0.0:1790920492.061058:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951220992 00000100:00100000:0.0:1790920492.061142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:0.0:1790920492.061155:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:10528:x1877915951220992:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:0.0:1790920492.061261:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061284:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061298:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061331:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061339:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061347:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061381:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920492.061386:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061395:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061411:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920492.061415:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920492.061421:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.061427:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920492.061946:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:10528:x1877915951220992:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 790us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920492.061957:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:2.0:1790920492.064581:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920492.064689:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951221248 00000100:00100000:1.0:1790920492.064701:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951221248 00000100:00100000:1.0:1790920492.064792:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:1.0:1790920492.064806:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:10528:x1877915951221248:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920492.065498:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+50:10528:x1877915951221248:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 692us (926us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1790920492.065511:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 28 00010000:00010000:1.0:1790920492.073153:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920492.138790:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972211584:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.138904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920492.138986:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972212096:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139020:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920492.139072:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790920492.139079:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972211712:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920492.139121:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972212224:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139148:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920492.139187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972211584 00000100:00100000:3.0:1790920492.139197:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972211584 00000100:00100000:3.0:1790920492.139268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790920492.139279:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972211584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139339:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb056a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972211584:12345-0@lo:400:kworker.0 Request processed in 62us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920492.139348:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790920492.139407:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972211584:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139434:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972212096 00000100:00100000:3.0:1790920492.139437:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972212096 00000100:00080000:3.0:1790920492.139464:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920492.139493:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972211712 00000100:00100000:3.0:1790920492.139496:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972211712 00000100:00100000:3.0:1790920492.139518:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790920492.139524:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972212096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139563:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972212096:12345-0@lo:400:kworker.0 Request processed in 39us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920492.139569:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790920492.139595:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972212096:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139613:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790920492.139631:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972211712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139675:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972211712:12345-0@lo:400:kworker.0 Request processed in 56us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920492.139682:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790920492.139706:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972211712:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139793:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972211968:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920492.139847:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920492.139854:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972211840:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920492.139905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972211840 00000100:00100000:3.0:1790920492.139909:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972211840 00000100:00080000:3.0:1790920492.139922:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920492.139940:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790920492.139946:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972211840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.139981:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972211840:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920492.139987:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790920492.140009:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972211840:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.140040:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972212224 00000100:00100000:3.0:1790920492.140044:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972212224 00000100:00100000:3.0:1790920492.140070:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972211968 00000100:00100000:3.0:1790920492.140073:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972211968 00000100:00100000:3.0:1790920492.140095:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790920492.140102:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1877915972212224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.140138:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1877915972212224:12345-0@lo:400:kworker.0 Request processed in 36us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920492.140156:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790920492.140168:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790920492.140174:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972211968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.140207:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972211968:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920492.140213:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1790920492.140226:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920492.140243:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972211968:0@lo:400:kworker.0 00000100:00100000:3.0:1790920492.140264:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972212224:0@lo:400:kworker.0 00000100:00100000:1.0:1790920492.178306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920492.178357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951221504 00000100:00100000:1.0:1790920492.178388:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951221504 00000100:00100000:1.0:1790920492.178473:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:1.0:1790920492.178486:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+50:10538:x1877915951221504:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920492.178521:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920492.178526:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790920492.178563:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a7f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabdc expref: 50 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.178587:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920492.178594:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920492.178611:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a878 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edabff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.179272:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a87f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.179293:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a87f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.179305:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a87f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920492.179319:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790920492.179493:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a878 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabff expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.179512:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a87f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabff expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.179520:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920492.179533:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920492.179537:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c800, rc 0) 00000100:00100000:1.0:1790920492.179639:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10538:x1877915951221504:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1155us (1347us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1790920492.179648:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:0.0:1790920492.198300:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920492.198537:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951221760 00000100:00100000:3.0:1790920492.198557:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951221760 00000100:00100000:3.0:1790920492.198665:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 105 00000100:00100000:3.0:1790920492.198678:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10538:x1877915951221760:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:3.0:1790920492.198785:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790920492.198828:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546a87f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabff expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.198860:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546a863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabf8 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.198872:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:3.0:1790920492.198879:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920492.200455:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.200486:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.200522:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790920492.200603:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1790920492.203667:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b0a74ca reply state 00000000798ca4f7 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920492.203686:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790920492.203835:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10538:x1877915951221760:12345-192.168.204.34@tcp:36:bash.0 Request processed in 5156us (5552us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1790920492.203845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 105 00000020:00080000:3.0:1790920492.203851:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790920492.212508:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.212528:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.212537:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.212545:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920492.212552:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.212561:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920492.212580:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:1.0:1790920492.212585:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920492.212592:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920492.212599:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.212606:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a88d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920492.212655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951221888 00000100:00100000:0.0:1790920492.212666:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951221888 00000100:00100000:0.0:1790920492.212742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:0.0:1790920492.212795:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:10538:x1877915951221888:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920492.213014:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920492.213036:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac06 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.213314:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.213550:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.213561:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920492.213594:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790920492.213599:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920492.213630:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.213659:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.213678:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.213687:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920492.213690:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920492.213693:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53e00, rc 0) 00000100:00100000:0.0:1790920492.216444:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10538:x1877915951221888:12345-192.168.204.34@tcp:101:bash.0 Request processed in 3639us (3862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920492.216457:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:1.0:1790920492.225028:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920492.225104:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951222144 00000100:00100000:0.0:1790920492.225115:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951222144 00000100:00100000:0.0:1790920492.225183:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:0.0:1790920492.225204:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:10538:x1877915951222144:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:0.0:1790920492.225687:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10538:x1877915951222144:12345-192.168.204.34@tcp:35:bash.0 Request processed in 483us (665us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1790920492.225714:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000001:00080000:3.0:1790920492.276613:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1790920492.276640:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1790920492.276650:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1790920492.276657:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1790920492.371644:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920492.371786:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951222272 00000100:00100000:0.0:1790920492.371796:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951222272 00000100:00100000:0.0:1790920492.371862:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:0.0:1790920492.371873:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:10544:x1877915951222272:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920492.371898:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920492.371920:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a8a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac0d expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.371984:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a8a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.371998:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.372008:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920492.372043:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790920492.372047:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920492.372066:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.372089:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a8a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac0d expref: 55 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.372244:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac0d expref: 54 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.372273:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920492.372276:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920492.372279:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52e00, rc 0) 00000100:00100000:0.0:1790920492.372450:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10544:x1877915951222272:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 578us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920492.372457:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:2.0:1790920492.378946:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920492.379101:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951222400 00000100:00100000:1.0:1790920492.379124:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951222400 00000100:00100000:1.0:1790920492.379210:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:1.0:1790920492.379220:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10544:x1877915951222400:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920492.379239:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920492.379259:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac14 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379318:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379348:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379360:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379377:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379383:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379390:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379479:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379487:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379493:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920492.379537:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790920492.379541:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920492.379560:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379572:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379580:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379587:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379594:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379601:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920492.379605:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379627:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379640:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920492.379642:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920492.379648:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379655:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a8b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379682:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379688:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379694:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379700:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920492.379702:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379709:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379716:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb01486900) 00010000:00010000:1.0:1790920492.379719:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920492.379721:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379726:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379817:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379831:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.379848:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920492.379850:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920492.379853:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443ca00, rc 0) 00000100:00100000:1.0:1790920492.379909:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10544:x1877915951222400:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 690us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920492.379916:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:1.0:1790920492.392869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920492.394013:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951222656 00000100:00100000:3.0:1790920492.394029:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951222656 00000100:00100000:3.0:1790920492.394186:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:3.0:1790920492.394199:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10544:x1877915951222656:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920492.394239:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920492.394269:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a8cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac1b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.394409:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.394427:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.394453:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.394462:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.394506:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.394522:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 56 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920492.394538:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972212352:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920492.395494:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.395545:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 56 pid: 5846 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920492.395566:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972212480:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920492.398379:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0a845e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920492.400628:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972212352:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920492.407609:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920492.407668:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920492.407850:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951222784 00000100:00100000:0.0:1790920492.407863:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951222784 00010000:00010000:0.0:1790920492.407928:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 57 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920492.407972:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951222912 00000100:00100000:0.0:1790920492.407976:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951222912 00010000:00010000:0.0:1790920492.407988:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 58 pid: 5846 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920492.408014:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:0.0:1790920492.408025:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:2354:x1877915951222784:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920492.408045:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920492.408052:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 58 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408067:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 58 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408095:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a8c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac14 expref: 58 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408137:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920492.408144:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408154:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408162:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920492.408229:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:2354:x1877915951222784:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 205us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920492.408237:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:0.0:1790920492.408259:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:0.0:1790920492.408267:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:2354:x1877915951222912:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920492.408276:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920492.408281:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 56 pid: 5846 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408291:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 56 pid: 5846 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408303:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920492.408306:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408315:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408335:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920492.408360:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920492.408380:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:2354:x1877915951222912:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 115us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920492.408387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00010000:00010000:3.0:1790920492.408544:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546a89b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac06 expref: 55 pid: 5846 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920492.408596:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972212480:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920492.408633:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.408643:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.408648:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920492.408671:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790920492.409263:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546a8cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.409284:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920492.409293:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:3.0:1790920492.409296:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790920492.409300:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36a00, rc 0) 00000100:00100000:3.0:1790920492.409378:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10544:x1877915951222656:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 15181us (16527us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1790920492.409388:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:1.0:1790920492.420072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920492.424350:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951223168 00000100:00100000:0.0:1790920492.424374:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951223168 00000100:00100000:2.0:1790920492.427863:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:2.0:1790920492.430773:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10544:x1877915951223168:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:2.0:1790920492.430807:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920492.430849:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546a832 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabf1 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920492.430889:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:2.0:1790920492.430896:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920492.430995:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10544:x1877915951223168:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 275us (10946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920492.431004:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1790920492.437182:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920492.437380:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951223296 00000100:00100000:1.0:1790920492.437394:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951223296 00000100:00100000:1.0:1790920492.437482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 110 00000100:00100000:1.0:1790920492.437495:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10544:x1877915951223296:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:1.0:1790920492.437682:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.437824:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.437841:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790920492.439261:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1790920492.439421:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10544:x1877915951223296:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 1924us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920492.439434:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 110 00000100:00100000:3.0:1790920492.449010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920492.452205:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951223424 00000100:00100000:0.0:1790920492.452363:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951223424 00000100:00100000:1.0:1790920492.452603:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 111 00000100:00100000:1.0:1790920492.452632:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:10544:x1877915951223424:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920492.452675:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920492.452714:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac22 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.452819:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.452833:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 55 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.452859:0:11700:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.452877:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 55 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.452906:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920492.452909:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790920492.452913:0:11700:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 55 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920492.452920:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d200, rc 0) 00000100:00100000:1.0:1790920492.453012:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10544:x1877915951223424:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 382us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920492.453020:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 111 00000004:00080000:2.0:1790920492.649580:0:7078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334815829575ns, next at 335815826063ns, rc = 0 00000100:00100000:0.0:1790920492.649667:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920492.649711:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972212608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920492.649851:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920492.650326:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972212608 00000100:00100000:1.0:1790920492.650356:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972212608 00000100:00100000:1.0:1790920492.650438:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790920492.650452:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972212608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790920492.650499:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920492.650573:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972212608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920492.650581:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790920492.650667:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972212608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920492.685212:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920492.686961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920492.687011:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920492.687069:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920492.687124:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951223680 00000100:00100000:3.0:1790920492.687138:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951223680 00000100:00100000:3.0:1790920492.687211:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951223808 00000100:00100000:3.0:1790920492.687214:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951223808 00000100:00080000:0.0:1790920492.687460:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920492.687486:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:0.0:1790920492.687502:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2352:x1877915951223680:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920492.687623:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2352:x1877915951223680:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 112us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920492.687631:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:1.0:1790920492.689075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951223552 00000100:00100000:1.0:1790920492.689090:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951223552 00000100:00100000:1.0:1790920492.689168:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 292 00000100:00100000:1.0:1790920492.689179:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951223552:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920492.690417:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:3.0:1790920492.690433:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2352:x1877915951223808:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920492.690572:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951223552:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 1392us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920492.690583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 292 00000100:00100000:0.0:1790920492.691368:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951223936 00000100:00100000:0.0:1790920492.691382:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951223936 00000100:00100000:0.0:1790920492.691455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 147 00000100:00100000:0.0:1790920492.691466:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951223936:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:2.0:1790920492.691719:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920492.693569:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2352:x1877915951223808:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 3124us (6484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920492.693587:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:0.0:1790920492.696081:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951223936:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 4600us (9115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920492.696124:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 147 00010000:00010000:3.0:1790920493.097240:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790920493.225262:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920493.225279:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920493.225362:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790920493.225372:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790920493.225551:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d30000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972212736:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790920493.226396:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb059499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920493.235958:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920493.236898:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d30000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972212736:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790920493.237008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951224064 00000100:00100000:3.0:1790920493.237022:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951224064 00000100:00100000:3.0:1790920493.237097:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:3.0:1790920493.237107:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10545:x1877915951224064:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790920493.237146:0:5847:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790920493.238427:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10545:x1877915951224064:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 1311us (2471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920493.238439:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:3.0:1790920493.258134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920493.258573:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951224192 00000100:00100000:2.0:1790920493.258586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951224192 00000100:00100000:2.0:1790920493.258725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:2.0:1790920493.258737:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10545:x1877915951224192:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790920493.258982:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259021:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259035:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259103:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259112:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259119:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259146:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259155:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259162:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920493.259207:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790920493.259224:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920493.259240:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259252:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259268:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259275:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259281:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ae00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920493.259285:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259292:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259305:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920493.259308:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920493.259314:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259320:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546a8ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259335:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259341:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259346:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259350:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920493.259359:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259365:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259373:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff88eb2cb2c000) 00010000:00010000:2.0:1790920493.259376:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920493.259378:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259384:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546a8f6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259737:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259795:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259801:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.259806:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920493.260481:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.260493:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.260505:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:2.0:1790920493.260508:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920493.260526:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.260532:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546a8fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.260769:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10545:x1877915951224192:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 2005us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920493.260780:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:0.0:1790920493.272503:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.273190:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951224448 00000100:00100000:1.0:1790920493.273203:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951224448 00000100:00100000:1.0:1790920493.273351:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:1.0:1790920493.273362:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:10545:x1877915951224448:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920493.273384:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920493.273406:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a904 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac29 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273774:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273792:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273812:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920493.273827:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790920493.273931:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273939:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273944:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273950:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.273954:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273961:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273974:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920493.273977:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790920493.273981:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.273987:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a90b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.274035:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a904 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac29 expref: 57 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.274056:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:1.0:1790920493.274059:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920493.274063:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a904 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac29 expref: 57 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.274073:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d800, rc 0) 00000100:00100000:1.0:1790920493.274192:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10545:x1877915951224448:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 831us (1703us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1790920493.274200:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:2.0:1790920493.286881:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.287251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951224576 00000100:00100000:0.0:1790920493.287263:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951224576 00000100:00100000:0.0:1790920493.287337:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:0.0:1790920493.287348:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10545:x1877915951224576:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790920493.287388:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790920493.287507:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10545:x1877915951224576:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 160us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.287514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:3.0:1790920493.294105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.294224:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951224832 00000100:00100000:0.0:1790920493.294235:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951224832 00000100:00100000:0.0:1790920493.294306:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:0.0:1790920493.294315:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10545:x1877915951224832:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920493.294336:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920493.294339:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790920493.294367:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a8a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac0d expref: 56 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.294386:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920493.294391:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920493.294405:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a919 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac30 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790920493.294912:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1790920493.295135:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.295149:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.295159:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.295218:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a919 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac30 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.295234:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac30 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.295241:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856fd00) 00010000:00010000:0.0:1790920493.295244:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920493.295246:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52600, rc 0) 00000100:00100000:0.0:1790920493.295322:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:10545:x1877915951224832:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1008us (1226us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1790920493.295330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:1.0:1790920493.303297:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.303664:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951225088 00000100:00100000:0.0:1790920493.303677:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951225088 00000100:00100000:0.0:1790920493.303766:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:0.0:1790920493.303776:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:10545:x1877915951225088:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790920493.303838:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920493.303868:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac30 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.303906:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856fd00) 00010000:00010000:0.0:1790920493.303916:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920493.303937:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.303950:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.303960:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.303974:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.303980:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.303987:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304052:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304059:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304067:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304073:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920493.304077:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304091:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304099:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920493.304101:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920493.304105:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304111:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a92e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304120:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304126:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304132:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304137:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920493.304140:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304145:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304151:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3a4ca6d5 (ffff88eb0856f100) 00010000:00010000:0.0:1790920493.304153:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920493.304155:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.304171:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a935 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3a4ca6d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.304254:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10545:x1877915951225088:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 478us (966us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790920493.304260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:3.0:1790920493.317810:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.318091:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951225216 00000100:00100000:0.0:1790920493.318102:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951225216 00000100:00100000:0.0:1790920493.318171:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:0.0:1790920493.318180:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:10545:x1877915951225216:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920493.318201:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920493.318228:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a93c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac37 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.318270:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.318285:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.318297:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.318407:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a93c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.318425:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.318446:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920493.318449:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790920493.318454:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52e00, rc 0) 00000100:00100000:0.0:1790920493.318529:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:10545:x1877915951225216:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 349us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.318536:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:1.0:1790920493.326245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.326540:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951225472 00000100:00100000:0.0:1790920493.326552:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951225472 00000100:00100000:0.0:1790920493.326635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:0.0:1790920493.326646:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:10545:x1877915951225472:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790920493.326743:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.326792:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.326805:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920493.327092:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1790920493.327197:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddd4d544 reply state 000000009fd1cde3 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.327207:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790920493.327329:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:10545:x1877915951225472:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 685us (1095us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1790920493.327337:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 119 00010000:00010000:3.0:1790920493.332640:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.332681:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.332689:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.332696:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920493.332701:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.332709:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.332726:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:3.0:1790920493.332729:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790920493.332734:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.332740:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a94a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.333430:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.334457:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951225600 00000100:00100000:0.0:1790920493.334474:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951225600 00000100:00100000:0.0:1790920493.334547:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:0.0:1790920493.334559:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:10545:x1877915951225600:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920493.334587:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920493.334623:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac3e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.334692:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.334707:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.334725:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920493.334729:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790920493.334733:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52600, rc 0) 00000100:00100000:0.0:1790920493.335714:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:10545:x1877915951225600:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1151us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.335724:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:2.0:1790920493.349181:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.349257:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951225728 00000100:00100000:0.0:1790920493.349269:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951225728 00000100:00100000:0.0:1790920493.349340:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:0.0:1790920493.349351:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951225728:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790920493.349964:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951225728:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 612us (791us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790920493.349973:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:3.0:1790920493.360239:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.361267:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951225984 00000100:00100000:0.0:1790920493.361285:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951225984 00000100:00100000:0.0:1790920493.361367:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:0.0:1790920493.361379:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:10545:x1877915951225984:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790920493.362331:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:10545:x1877915951225984:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 950us (2097us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1790920493.362341:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:1.0:1790920493.373078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920493.373247:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951226240 00000100:00100000:3.0:1790920493.373260:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951226240 00000100:00100000:3.0:1790920493.373337:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:3.0:1790920493.373349:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:10545:x1877915951226240:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790920493.373509:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:10545:x1877915951226240:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 161us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920493.373517:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:2.0:1790920493.377275:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.377376:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951226368 00000100:00100000:1.0:1790920493.377398:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951226368 00000100:00100000:1.0:1790920493.377469:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:1.0:1790920493.377480:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:10545:x1877915951226368:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920493.377504:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920493.377530:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a958 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac45 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.377953:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a95f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.377979:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.377991:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920493.378031:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920493.378055:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.378086:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a958 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac45 expref: 62 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.378107:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac45 expref: 61 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.378115:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920493.378118:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790920493.378122:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d600, rc 0) 00000100:00100000:1.0:1790920493.378270:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:10545:x1877915951226368:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 792us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920493.378278:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:2.0:1790920493.389855:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.390010:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951226496 00000100:00100000:1.0:1790920493.390022:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951226496 00000100:00100000:1.0:1790920493.390088:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:1.0:1790920493.390099:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951226496:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920493.390118:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920493.390155:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac4c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790920493.390185:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf472d, blocks: 0x1 00010000:00010000:1.0:1790920493.390205:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1790920493.390209:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920493.390218:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 10 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.390235:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 10 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.390248:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d800, rc 0) 00000100:00100000:1.0:1790920493.390311:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2355:x1877915951226496:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 213us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920493.390318:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:3.0:1790920493.392629:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.392788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951226752 00000100:00100000:1.0:1790920493.392798:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951226752 00000100:00100000:1.0:1790920493.392868:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:1.0:1790920493.392877:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:10545:x1877915951226752:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790920493.392987:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:10545:x1877915951226752:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920493.392994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:2.0:1790920493.397471:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920493.397643:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951226880 00000100:00100000:3.0:1790920493.397655:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951226880 00000100:00100000:3.0:1790920493.397725:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:3.0:1790920493.397734:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:10545:x1877915951226880:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790920493.397789:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920493.398047:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac53 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.398088:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.398097:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920493.398102:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920493.398108:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.398143:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.398159:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 11 pid: 6690 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.398172:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877915972212864:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920493.398273:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0a845e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920493.411028:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920493.411378:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877915972212864:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920493.411448:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.411473:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36400, rc 0) 00000100:00100000:3.0:1790920493.411542:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:10545:x1877915951226880:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 13809us (14080us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920493.411551:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:1.0:1790920493.412027:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951227008 00000100:00100000:1.0:1790920493.412035:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951227008 00010000:00010000:1.0:1790920493.412069:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 11 pid: 6690 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.416307:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:1.0:1790920493.416332:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:2354:x1877915951227008:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920493.416354:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920493.416397:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 11 pid: 6690 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.416418:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 11 pid: 6690 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.416443:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb89fe5c/0x2a4915844546a966 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac4c expref: 11 pid: 6690 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.416462:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920493.416466:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920493.416475:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.416485:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.416532:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.416547:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1877915972212992:192.168.204.34@tcp:105: 00000100:00100000:1.0:1790920493.416680:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41bd5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920493.429878:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1877915972212992:192.168.204.34@tcp:105: 00010000:00010000:2.0:1790920493.429913:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920493.429998:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2354:x1877915951227008:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 13677us (18978us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920493.430009:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:1.0:1790920493.430134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920493.430928:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951227136 00000100:00100000:2.0:1790920493.430940:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951227136 00002000:00100000:2.0:1790920493.430996:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88eb41c72300 x1877915951227136/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:104/0 lens 504/0 e 0 to 0 dl 1790920504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790920493.431008:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb41c72300 with x1877915951227136 ext(0->12) 00002000:00010000:2.0:1790920493.431013:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb41c72300 00000100:00100000:2.0:1790920493.431043:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:2.0:1790920493.431053:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2354:x1877915951227136:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790920493.431652:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:2354:x1877915951227136:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 598us (1525us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790920493.431671:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00002000:00100000:2.0:1790920493.431679:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88eb41c72300 x1877915951227136/t4294967308(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:104/0 lens 504/448 e 0 to 0 dl 1790920504 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790920493.431688:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb41c72300 with x1877915951227136 ext(0->12) 00002000:00010000:2.0:1790920493.431692:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb41c72300 00000100:00100000:0.0:1790920493.436267:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920493.436590:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951227264 00000100:00100000:3.0:1790920493.436615:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951227264 00000100:00100000:3.0:1790920493.436698:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 124 00000100:00100000:3.0:1790920493.436710:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:10545:x1877915951227264:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790920493.488615:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1790920493.488647:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790920493.488690:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88eb067e2e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790920493.488696:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb0715ea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88eb067e20c0 00000020:00080000:2.0:1790920493.488700:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb0715e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb41895400 00000020:00080000:2.0:1790920493.488722:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1790920493.488786:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1790920493.488816:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1790920493.488823:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88eb41bd5780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790920493.488826:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3f98ff00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88eb41bd5e40 00000020:00080000:2.0:1790920493.488829:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3f98fe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb3aa7e400 00000020:00080000:2.0:1790920493.488869:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1790920493.489097:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790920493.489259:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972213120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790920493.489346:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920493.489422:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972213120 00000100:00100000:2.0:1790920493.489431:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972213120 00000100:00100000:2.0:1790920493.489480:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790920493.489489:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972213120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790920493.489537:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1790920493.489573:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.489652:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.489662:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1790920493.489668:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920493.489673:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.489704:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.489719:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 11 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920493.489733:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1877915972213248:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920493.489826:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb059496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920493.490790:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972213376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790920493.490848:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920493.491434:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972213376 00000100:00100000:1.0:1790920493.491444:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972213376 00000100:00100000:1.0:1790920493.491513:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790920493.491525:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972213376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790920493.491555:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1790920493.491610:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abf472b, atime: 0x6abf472c, ctime: 0x6abf472b, blocks: 0xb 00010000:00010000:1.0:1790920493.491620:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.491641:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1790920493.491646:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920493.491654:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.491673:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.491685:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.491694:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.491714:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790920493.492493:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972213376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 965us (1639us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790920493.492514:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1790920493.492562:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920493.492571:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.492584:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ca00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920493.492589:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.492613:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.492637:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.492646:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048bf2e20/0x2a4915844546a97b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.492672:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920493.492674:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920493.492676:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790920493.492972:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790920493.493023:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1790920493.493031:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1790920493.493057:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb33ff9c00, transno 4294967301 00000004:00080000:2.0:1790920493.493081:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1790920493.493104:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88eb41c73800 x1877915972213376/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790920509 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790920493.493279:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb41c73800/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790920493.493288:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972213376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790920493.493891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.494928:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951227392 00000100:00100000:1.0:1790920493.494942:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951227392 00010000:00010000:1.0:1790920493.494990:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 12 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.495060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:1.0:1790920493.495071:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:2354:x1877915951227392:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920493.495090:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920493.495096:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 12 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.495111:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 12 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.495323:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920493.495329:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920493.495336:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.495348:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.495372:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920493.495480:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:2354:x1877915951227392:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 409us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920493.495488:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:0.0:1790920493.495683:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:10545:x1877915951227264:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 58974us (59431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.495692:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 124 00010000:00010000:3.0:1790920493.496413:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b093825f/0x2a4915844546a736 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edabb2 expref: 11 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.496439:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1877915972213248:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920493.496480:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.497775:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.497798:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.497811:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.497819:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.497845:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920493.498046:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920493.498055:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.498063:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a400 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920493.498069:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.498103:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.498138:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.498147:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deeaafa2/0x2a4915844546a974 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.498176:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920493.498178:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920493.498180:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920493.500008:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877915972213120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10509us (10651us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790920493.500027:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1790920493.500454:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb3f571c00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1790920493.501044:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972213120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790920493.501931:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920493.502021:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951227520 00000100:00100000:3.0:1790920493.502034:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951227520 00000100:00100000:3.0:1790920493.502109:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:3.0:1790920493.502121:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:2352:x1877915951227520:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1790920493.563229:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1790920493.563254:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1790920493.563274:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1790920493.563621:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951227520:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 61493us (61688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920493.563635:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:3.0:1790920493.568088:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.570855:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951227776 00000100:00100000:1.0:1790920493.570875:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951227776 00000100:00100000:1.0:1790920493.570972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 125 00000100:00100000:1.0:1790920493.570985:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:10545:x1877915951227776:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790920493.571062:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920493.571104:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a95f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac45 expref: 15 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.571133:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920493.571139:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920493.571731:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.571881:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.571897:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920493.572336:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082fc82be reply state 0000000075cfb4e6 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.572370:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790920493.572526:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:10545:x1877915951227776:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 1540us (4451us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1790920493.572535:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 125 00010000:00010000:1.0:1790920493.577534:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.577667:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.577679:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.577687:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ca00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.577692:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.577726:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.577886:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:1.0:1790920493.577911:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920493.577915:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920493.577923:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.577930:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ca00/0x2a4915844546a982 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.578020:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951227904 00000100:00100000:0.0:1790920493.578033:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951227904 00000100:00100000:0.0:1790920493.578100:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:0.0:1790920493.578113:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951227904:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790920493.578494:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790920493.578499:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790920492 00002000:00010000:0.0:1790920493.578501:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790920492 00002000:00010000:0.0:1790920493.578504:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790920493 -> 1790920492 00002000:00010000:0.0:1790920493.578507:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790920493.578781:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951227904:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 629us (860us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790920493.578793:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:2.0:1790920493.580579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.581043:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951228160 00000100:00100000:1.0:1790920493.581057:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951228160 00000100:00100000:0.0:1790920493.581252:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:0.0:1790920493.581265:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:10545:x1877915951228160:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790920493.581363:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.581387:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.581399:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.581468:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.581483:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 15 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.581501:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41827b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972213504:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920493.581634:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb1091c180 going to sleep for 11 seconds 00000100:00100000:3.0:1790920493.586460:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.586948:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41827b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972213504:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920493.586994:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920493.587094:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951228288 00000100:00100000:2.0:1790920493.587104:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951228288 00010000:00010000:2.0:1790920493.587157:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920493.587214:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:2.0:1790920493.587227:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:2354:x1877915951228288:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920493.587247:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920493.587255:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.587270:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.587299:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac37 expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.587339:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:2.0:1790920493.587344:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.587357:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.587366:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920493.587397:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920493.587472:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:2354:x1877915951228288:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 248us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920493.587479:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00010000:00010000:0.0:1790920493.588175:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588187:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588241:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588249:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588256:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588262:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920493.588267:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588287:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588299:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:0.0:1790920493.588302:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790920493.588307:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.588313:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a989 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.588379:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:10545:x1877915951228160:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 7116us (7812us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790920493.588389:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:3.0:1790920493.607237:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.607409:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951228416 00000100:00100000:1.0:1790920493.607423:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951228416 00000100:00100000:1.0:1790920493.607505:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:1.0:1790920493.607519:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951228416:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790920493.607583:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.607631:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.607642:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920493.607647:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920493.607652:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.607723:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.607740:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 7 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.607804:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972213632:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920493.607979:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920493.619312:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920493.619452:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972213632:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920493.619486:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.627161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951228544 00000100:00100000:3.0:1790920493.627187:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951228544 00010000:00010000:3.0:1790920493.627270:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 8 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.627327:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:3.0:1790920493.627359:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951228544:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920493.627379:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920493.627409:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 8 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.627425:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 8 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.627470:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000659aa461/0x2a4915844546a96d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac53 expref: 8 pid: 6688 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.627494:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920493.627499:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920493.627506:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.627519:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.627555:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920493.627907:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.627920:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.627953:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.627962:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.627970:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.627991:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ca00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920493.627997:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.628009:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.628026:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.628034:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048bf2e20/0x2a4915844546a990 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.628423:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951228416:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 20903us (21198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.628435:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:0.0:1790920493.628902:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951228544:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 1544us (9604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.628913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:0.0:1790920493.634374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920493.634479:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951228800 00000100:00100000:3.0:1790920493.634496:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951228800 00000100:00100000:3.0:1790920493.634577:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 127 00000100:00100000:3.0:1790920493.634600:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:10545:x1877915951228800:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790920493.634732:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.634821:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.634838:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.635147:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.635160:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.635169:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.635216:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.635233:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 15 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.635250:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972213760:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920493.635359:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0a9aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920493.639910:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.640033:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972213760:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920493.640071:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.640337:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951228928 00000100:00100000:1.0:1790920493.640347:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951228928 00010000:00010000:1.0:1790920493.640397:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.640446:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:1.0:1790920493.640542:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:2355:x1877915951228928:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920493.640566:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920493.640575:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.640599:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.640655:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac3e expref: 16 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.640678:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920493.640684:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.640694:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.640702:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.640817:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920493.640890:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:2355:x1877915951228928:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 432us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920493.640898:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00010000:00010000:0.0:1790920493.646415:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.647322:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920493.648164:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1790920493.649081:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1790920493.649145:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1790920493.650375:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1877915972213888:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790920493.650490:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920493.650602:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920493.653345:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972213888 00000100:00100000:3.0:1790920493.653368:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972213888 00000100:00100000:3.0:1790920493.653477:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790920493.653491:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1877915972213888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790920493.654048:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1877915972213888:12345-0@lo:1000:mdt00_000.0 Request processed in 558us (3557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920493.654059:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790920493.654169:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1790920493.654179:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1790920493.654219:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb3f571c00, transno 4294967309 00000100:00100000:0.0:1790920493.654246:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1877915972213888:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1790920493.660875:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1790920493.661002:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1877915972214016:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790920493.661099:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920493.661141:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1790920493.661480:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972214016 00000100:00100000:2.0:1790920493.661490:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972214016 00000100:00100000:2.0:1790920493.661562:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790920493.661574:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1877915972214016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790920493.671942:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1877915972214016:12345-0@lo:1000:mdt00_000.0 Request processed in 10353us (10826us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790920493.671963:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920493.674848:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1877915972214016:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790920493.674931:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.674946:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.674982:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.674989:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.674995:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675003:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675022:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856f100) 00010000:00010000:1.0:1790920493.675026:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790920493.675032:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675039:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546a99e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675085:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675092:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675097:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675103:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.675106:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675120:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675129:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920493.675132:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790920493.675139:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675151:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.675161:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.677787:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.677825:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f526300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972214144:192.168.204.34@tcp:105: 00000100:00100000:1.0:1790920493.677972:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f1300 going to sleep for 11 seconds 00000100:00100000:3.0:1790920493.685326:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.685425:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951229056 00000100:00100000:0.0:1790920493.685437:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951229056 00000100:00100000:0.0:1790920493.685531:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:0.0:1790920493.685543:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10544:x1877915951229056:12345-192.168.204.34@tcp:49:lfs.0 00000100:00100000:0.0:1790920493.685773:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10544:x1877915951229056:12345-192.168.204.34@tcp:49:lfs.0 Request processed in 205us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.685782:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:1.0:1790920493.686578:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f526300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972214144:192.168.204.34@tcp:105: 00010000:00010000:1.0:1790920493.686638:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686651:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546a8e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686694:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686728:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686742:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686804:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686812:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686820:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686826:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.686830:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686837:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686850:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920493.686853:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920493.686857:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686863:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686872:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686884:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686889:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686894:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.686897:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.686902:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.690563:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920493.690577:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790920493.690600:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.690718:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546a997 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920493.691084:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:10545:x1877915951228800:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 56490us (56721us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1790920493.691098:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 127 00000020:00080000:1.0:1790920493.691105:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790920493.691557:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790920493.691564:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790920493.692093:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790920493.692105:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790920493.699334:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920493.699390:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920493.699812:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951229568 00000100:00100000:3.0:1790920493.699827:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951229568 00000100:00100000:3.0:1790920493.699908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:3.0:1790920493.699921:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:10544:x1877915951229568:12345-192.168.204.34@tcp:58:lfs.0 00000040:00080000:3.0:1790920493.700447:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1790920493.701036:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951229312 00000100:00100000:0.0:1790920493.701049:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951229312 00000100:00100000:0.0:1790920493.701112:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:0.0:1790920493.701134:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:10545:x1877915951229312:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790920493.702306:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:10544:x1877915951229568:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 2380us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920493.702321:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 128 00000004:00080000:0.0:1790920493.702964:0:5848:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790920493.703095:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:0.0:1790920493.703180:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.703202:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.703217:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.703228:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.703235:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.703241:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.703277:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790920493.703375:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:10545:x1877915951229312:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 2241us (4054us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1790920493.703386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000020:00080000:0.0:1790920493.703392:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790920493.704014:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920493.704026:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.704035:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920493.704039:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.704049:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.704066:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88eb0856fe00) 00010000:00010000:3.0:1790920493.704082:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790920493.704089:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.704095:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546a9ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920493.704119:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920493.704121:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920493.704123:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920493.734509:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.734641:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951229696 00000100:00100000:0.0:1790920493.734656:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951229696 00000100:00100000:0.0:1790920493.734734:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 129 00000100:00100000:0.0:1790920493.734789:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:10547:x1877915951229696:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920493.734846:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920493.734875:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a9b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.734967:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.734985:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.734999:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735017:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735024:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735031:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735332:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735343:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735352:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735390:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.735412:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 21 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.735428:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972214272:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920493.735528:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920493.738331:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972214272:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920493.738371:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920493.739496:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920493.739713:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951229952 00000100:00100000:2.0:1790920493.739724:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951229952 00000100:00100000:2.0:1790920493.739831:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:2.0:1790920493.739844:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:6053:x1877915951229952:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790920493.740156:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:6053:x1877915951229952:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 312us (668us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790920493.740186:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:1.0:1790920493.745233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920493.745425:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951230080 00000100:00100000:0.0:1790920493.745441:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951230080 00010000:00010000:0.0:1790920493.745513:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 23 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920493.745569:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:0.0:1790920493.745582:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:2355:x1877915951230080:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920493.745613:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920493.745622:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 23 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.745639:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 23 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.745668:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546a8d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac1b expref: 23 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.745709:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920493.745720:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.745732:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.745743:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920493.745849:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920493.745922:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:2355:x1877915951230080:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 343us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920493.745930:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00010000:00010000:1.0:1790920493.746918:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.746935:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920493.747009:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790920493.747013:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920493.747037:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747053:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747064:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747072:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747079:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747086:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.747091:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747099:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747113:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:1.0:1790920493.747116:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920493.747121:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747128:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546a9ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747159:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747166:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747173:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747179:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920493.747182:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747189:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747198:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88eb0856fd00) 00010000:00010000:1.0:1790920493.747534:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920493.747540:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747547:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546a9c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747614:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546a9b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac5a expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747632:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac5a expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920493.747655:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920493.747658:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920493.747661:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53800, rc 0) 00000100:00100000:1.0:1790920493.747863:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10547:x1877915951229696:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 13117us (13369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920493.747872:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 129 00010000:00010000:3.0:1790920494.127608:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920494.185028:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972214400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920494.185223:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920494.185327:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972214400 00000100:00100000:1.0:1790920494.185338:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972214400 00000100:00100000:1.0:1790920494.185395:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790920494.185406:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972214400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920494.185460:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920494.185515:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972214400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920494.185523:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790920494.185598:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972214400:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1790920494.698473:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790920494.698491:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790920494.698560:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790920494.698582:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790920494.699022:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f56a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972214528:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790920494.699165:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02467480 going to sleep for 11 seconds 00000100:00100000:2.0:1790920494.705807:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f56a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972214528:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790920494.710606:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920494.711054:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951230208 00000100:00100000:1.0:1790920494.711071:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951230208 00000100:00100000:1.0:1790920494.711172:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 130 00000100:00100000:1.0:1790920494.711200:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10559:x1877915951230208:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790920494.711255:0:11700:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790920494.711415:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10559:x1877915951230208:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 231us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920494.711434:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 130 00000100:00080000:0.0:1790920494.713706:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920494.723852:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920494.723982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951230464 00000100:00100000:0.0:1790920494.723995:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951230464 00000100:00100000:0.0:1790920494.724086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:0.0:1790920494.724099:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:10559:x1877915951230464:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920494.724127:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920494.724386:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53200/0x2a4915844546a9cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac61 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920494.724530:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a9d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920494.724548:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920494.724597:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920494.724614:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790920494.724905:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53200/0x2a4915844546a9cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac61 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920494.724930:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac61 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920494.724941:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920494.724945:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920494.724949:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53400, rc 0) 00000100:00100000:0.0:1790920494.725090:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:10559:x1877915951230464:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 993us (1254us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1790920494.725099:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:2.0:1790920494.740610:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920494.740708:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951230592 00000100:00100000:0.0:1790920494.740721:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951230592 00000100:00100000:0.0:1790920494.740942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1790920494.740954:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:2354:x1877915951230592:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920494.740975:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920494.741009:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546a9d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac61 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920494.741040:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:0.0:1790920494.741047:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920494.741147:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:2354:x1877915951230592:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 194us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920494.741155:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1790920494.749382:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920494.749535:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951230848 00000100:00100000:1.0:1790920494.749549:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951230848 00000100:00100000:1.0:1790920494.749670:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 132 00000100:00100000:1.0:1790920494.749683:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:10559:x1877915951230848:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790920494.749820:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.749843:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.749858:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.750183:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.750192:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.750200:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.750207:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920494.750212:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.750219:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.750249:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920494.750252:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790920494.750260:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.750266:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920494.750470:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:10559:x1877915951230848:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 788us (1104us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790920494.750480:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 132 00000040:00080000:0.0:1790920494.751671:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790920494.751680:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920494.752929:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790920494.752950:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790920494.758463:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920494.758797:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951231104 00000100:00100000:2.0:1790920494.758811:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951231104 00000100:00100000:2.0:1790920494.759017:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:2.0:1790920494.759043:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:10559:x1877915951231104:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790920494.759410:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:10559:x1877915951231104:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 368us (974us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1790920494.759420:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000040:00080000:0.0:1790920494.765914:0:12067:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790920494.765926:0:12067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920494.765973:0:12067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790920494.765981:0:12067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790920494.982509:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920494.983329:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951231360 00000100:00100000:1.0:1790920494.983341:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951231360 00000100:00100000:1.0:1790920494.983475:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:1.0:1790920494.983487:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:10572:x1877915951231360:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920494.983513:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920494.983534:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac68 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.983676:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.983693:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.983714:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920494.983726:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790920494.983934:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546a9eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac68 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.983955:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac68 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.983975:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920494.983978:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790920494.983982:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d600, rc 0) 00000100:00100000:1.0:1790920494.984065:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:10572:x1877915951231360:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 580us (1566us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1790920494.984073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:2.0:1790920494.989305:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920494.989498:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951231488 00000100:00100000:1.0:1790920494.989512:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951231488 00000100:00100000:1.0:1790920494.989606:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 134 00000100:00100000:1.0:1790920494.989621:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:10572:x1877915951231488:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:1.0:1790920494.989718:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990144:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990163:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990201:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990209:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990240:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990247:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920494.990252:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990261:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990275:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:1.0:1790920494.990278:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920494.990284:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920494.990290:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546aa00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920494.990395:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:10572:x1877915951231488:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 777us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920494.990403:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 134 00010000:00010000:3.0:1790920495.145233:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920495.157176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920495.157327:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951231616 00000100:00100000:0.0:1790920495.157342:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951231616 00000100:00100000:0.0:1790920495.157441:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:0.0:1790920495.157454:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951231616:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:0.0:1790920495.157478:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920495.157509:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546aa07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac6f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790920495.157546:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abf472c, atime: 0x6abf472c, ctime: 0x6abf472c, blocks: 0xb 00010000:00010000:0.0:1790920495.157587:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1790920495.157593:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920495.157605:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546aa07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac6f expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920495.157632:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546aa07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac6f expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920495.157673:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53200, rc 0) 00000100:00080000:2.0:1790920495.157837:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920495.157910:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2353:x1877915951231616:12345-192.168.204.34@tcp:101:cat.0 Request processed in 458us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920495.157918:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:2.0:1790920495.178705:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920495.179226:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951231744 00000100:00100000:1.0:1790920495.179243:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951231744 00002000:00100000:1.0:1790920495.179317:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88eb3f570e00 x1877915951231744/t0(0) o3->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:106/0 lens 488/0 e 0 to 0 dl 1790920506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920495.179330:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3f570e00 with x1877915951231744 ext(0->4095) 00002000:00010000:1.0:1790920495.179336:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3f570e00 00000100:00100000:1.0:1790920495.179431:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:1.0:1790920495.179443:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951231744:12345-192.168.204.34@tcp:3:cat.0 00000100:00100000:1.0:1790920495.179843:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951231744:12345-192.168.204.34@tcp:3:cat.0 Request processed in 399us (1154us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790920495.179852:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00002000:00100000:1.0:1790920495.179860:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88eb3f570e00 x1877915951231744/t0(0) o3->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:106/0 lens 488/4536 e 0 to 0 dl 1790920506 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920495.179869:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3f570e00 with x1877915951231744 ext(0->4095) 00002000:00010000:1.0:1790920495.179873:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3f570e00 00010000:00010000:3.0:1790920496.169245:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920497.196397:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920497.259151:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972214912:0@lo:400:kworker.0 00000100:00100000:0.0:1790920497.259247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920497.259394:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972214656:0@lo:400:kworker.0 00000100:00100000:2.0:1790920497.259432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920497.259538:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972214784:0@lo:400:kworker.0 00000100:00100000:1.0:1790920497.259572:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920497.259861:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972214656 00000100:00100000:3.0:1790920497.259870:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972214656 00000100:00100000:3.0:1790920497.259917:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790920497.259927:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972214656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920497.259985:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972214656:12345-0@lo:400:kworker.0 Request processed in 59us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920497.260006:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1790920497.260645:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920497.260658:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972215040:0@lo:400:kworker.0 00000100:00100000:0.0:1790920497.260693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920497.260729:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972214912 00000100:00100000:0.0:1790920497.260734:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972214912 00000100:00100000:0.0:1790920497.260788:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972214784 00000100:00100000:0.0:1790920497.260791:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972214784 00000100:00100000:0.0:1790920497.260811:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790920497.260817:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972214912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920497.260856:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972214912:12345-0@lo:400:kworker.0 Request processed in 38us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920497.260862:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790920497.260875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790920497.260880:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972214784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920497.260902:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972214784:12345-0@lo:400:kworker.0 Request processed in 22us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920497.260908:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790920497.260923:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215040 00000100:00100000:0.0:1790920497.260933:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215040 00000100:00100000:0.0:1790920497.260959:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790920497.260964:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972215040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920497.260991:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972215040:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920497.260996:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1790920497.261010:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790920497.261014:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920497.261044:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972215040:0@lo:400:kworker.0 00000100:00100000:0.0:1790920497.261056:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972214912:0@lo:400:kworker.0 00000100:00100000:2.0:1790920497.264444:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972214656:0@lo:400:kworker.0 00000100:00100000:2.0:1790920497.264461:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972215168:0@lo:400:kworker.0 00000100:00100000:2.0:1790920497.264538:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920497.265226:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972214784:0@lo:400:kworker.0 00000100:00100000:1.0:1790920497.265237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972215296:0@lo:400:kworker.0 00000100:00100000:1.0:1790920497.265286:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920497.265356:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215296 00000100:00100000:1.0:1790920497.265363:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215296 00000100:00100000:1.0:1790920497.265423:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790920497.265432:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972215296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920497.265484:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972215296:12345-0@lo:400:kworker.0 Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920497.265492:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1790920497.265511:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920497.265547:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972215296:0@lo:400:kworker.0 00000100:00100000:2.0:1790920497.266933:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215168 00000100:00100000:2.0:1790920497.266942:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215168 00000100:00100000:2.0:1790920497.267043:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790920497.267052:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972215168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920497.267129:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972215168:12345-0@lo:400:kworker.0 Request processed in 78us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920497.267153:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790920497.267194:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972215168:0@lo:400:kworker.0 00000100:00080000:1.0:1790920497.268674:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1790920497.333442:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000004:00080000:0.0:1790920497.769397:0:7078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339935646150ns, next at 340935642787ns, rc = 0 00000100:00100000:1.0:1790920497.769450:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790920497.769487:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972215424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920497.769598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920497.769912:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215424 00000100:00100000:0.0:1790920497.769924:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215424 00000100:00100000:0.0:1790920497.769988:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790920497.769998:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972215424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920497.770047:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920497.770126:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972215424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920497.770135:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920497.770259:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972215424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920497.806157:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920497.806281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920497.806331:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920497.806372:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951231872 00000100:00100000:3.0:1790920497.806385:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951232128 00000100:00100000:0.0:1790920497.806389:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951231872 00000100:00100000:3.0:1790920497.806393:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951232128 00000100:00100000:3.0:1790920497.806473:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:0.0:1790920497.806478:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 294 00000100:00100000:3.0:1790920497.806490:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2353:x1877915951232128:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920497.806491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920497.806491:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951231872:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920497.806598:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951232384 00000100:00100000:2.0:1790920497.806603:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951232384 00000100:00100000:0.0:1790920497.806620:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951231872:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 123us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920497.806622:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2353:x1877915951232128:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 137us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920497.806638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 294 00000100:00100000:3.0:1790920497.806639:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:2.0:1790920497.806653:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951232000 00000100:00100000:2.0:1790920497.806657:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951232000 00000100:00100000:2.0:1790920497.806689:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00100000:2.0:1790920497.806697:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951232384:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920497.806738:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 152 00000100:00100000:3.0:1790920497.806791:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:2353:x1877915951232000:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920497.806957:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00080000:1.0:1790920497.807028:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790920497.807034:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920497.807382:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951232384:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 683us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920497.807383:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:2353:x1877915951232000:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 634us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920497.807400:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00100000:3.0:1790920497.807407:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 152 00000100:00100000:0.0:1790920497.807910:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951232256 00000100:00100000:0.0:1790920497.807919:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951232256 00000100:00100000:0.0:1790920497.808017:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:0.0:1790920497.808025:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951232256:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920497.808097:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951232256:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 72us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920497.808104:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00080000:1.0:1790920497.808255:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790920498.219875:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790920498.847351:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1790920498.847376:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:2.0:1790920498.863713:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920498.863728:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920498.863793:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790920498.863801:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1790920498.885891:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1790920498.885938:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:0.0:1790920498.885966:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1790920498.885987:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88eb050e23c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1790920498.885992:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb0715ec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88eb050e2840 00000020:00080000:0.0:1790920498.885996:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb0715e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb3446a800 00000020:00080000:0.0:1790920498.886023:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1790920498.886181:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920498.886210:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972215552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790920498.886301:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920498.886392:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215552 00000100:00100000:1.0:1790920498.886401:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215552 00000100:00100000:1.0:1790920498.886459:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790920498.886470:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972215552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790920498.887073:0:8267:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790920498.887078:0:8267:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790920492 -> 1790920492 00002000:00010000:1.0:1790920498.887081:0:8267:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1790920492 -> 1790920492 00002000:00010000:1.0:1790920498.887083:0:8267:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790920492 -> 1790920492 00002000:00010000:1.0:1790920498.887085:0:8267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790920498.887387:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972215552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 915us (1083us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790920498.887398:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000020:00080000:2.0:1790920498.887497:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1790920498.887736:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1790920498.888042:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1790920498.888049:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1790920498.888076:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88eb3af12d80 x1877915972215552/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790920514 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790920498.888090:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb3af12d80/2, rc 0, transno 4294967312 00000100:00100000:0.0:1790920498.888096:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972215552:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1790920499.242874:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920499.304911:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790920499.305025:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972215680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920499.305116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920499.305197:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215680 00000100:00100000:1.0:1790920499.305206:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215680 00000100:00100000:1.0:1790920499.305270:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790920499.305280:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33cbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972215680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920499.305322:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920499.305367:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33cbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972215680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920499.305374:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1790920499.308709:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920499.311339:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1790920499.311356:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb41c73800, transno 4294967304 00000100:00100000:1.0:1790920499.311407:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972215680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790920500.266624:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920500.332944:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920500.333122:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951232512 00000100:00100000:1.0:1790920500.333136:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951232512 00000100:00100000:1.0:1790920500.333239:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 135 00000100:00100000:1.0:1790920500.333252:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:10233:x1877915951232512:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790920500.333414:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:10233:x1877915951232512:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 Request processed in 164us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920500.333424:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 135 00000100:00080000:2.0:1790920500.333739:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920500.338172:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920500.338627:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951232768 00000100:00100000:2.0:1790920500.338642:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951232768 00000100:00100000:2.0:1790920500.338723:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:2.0:1790920500.338736:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:10233:x1877915951232768:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790920500.340424:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:10233:x1877915951232768:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 1677us (2255us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790920500.340449:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00010000:00010000:3.0:1790920501.291499:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920502.314523:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920502.378017:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972215936:0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.378089:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920502.378144:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972216448:0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.378169:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920502.378199:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920502.378216:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972216064:0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.378242:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920502.378277:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215936 00000100:00100000:3.0:1790920502.378285:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215936 00000100:00100000:3.0:1790920502.378330:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972216064 00000100:00100000:3.0:1790920502.378334:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972216064 00000100:00100000:3.0:1790920502.378363:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790920502.378372:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972215936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.378435:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972215936:12345-0@lo:400:kworker.0 Request processed in 64us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920502.378443:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790920502.378461:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790920502.378468:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972216064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.378497:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972216064:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920502.378503:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790920502.378545:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972216064:0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.378556:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972215936:0@lo:400:kworker.0 00000100:00100000:0.0:1790920502.378618:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972215808:0@lo:400:kworker.0 00000100:00100000:0.0:1790920502.378654:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920502.378693:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972216320:0@lo:400:kworker.0 00000100:00100000:0.0:1790920502.378716:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920502.378742:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920502.378772:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972216192:0@lo:400:kworker.0 00000100:00100000:0.0:1790920502.378795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920502.378821:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972216448 00000100:00100000:0.0:1790920502.378824:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972216448 00000100:00100000:0.0:1790920502.378855:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972216192 00000100:00100000:0.0:1790920502.378858:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972216192 00000100:00100000:0.0:1790920502.378880:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790920502.378887:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972216448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920502.378923:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972216448:12345-0@lo:400:kworker.0 Request processed in 36us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920502.378929:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790920502.378943:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790920502.378949:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972216192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920502.378980:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972216192:12345-0@lo:400:kworker.0 Request processed in 31us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920502.378985:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790920502.379017:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972216192:0@lo:400:kworker.0 00000100:00100000:2.0:1790920502.379139:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972216320 00000100:00100000:2.0:1790920502.379144:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972216320 00000100:00100000:2.0:1790920502.379174:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790920502.379181:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972216320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920502.379222:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972216320:12345-0@lo:400:kworker.0 Request processed in 41us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920502.379228:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1790920502.379255:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790920502.379259:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920502.379262:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920502.379280:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972216320:0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.380974:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972215808 00000100:00100000:3.0:1790920502.380987:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972215808 00000100:00100000:3.0:1790920502.381127:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790920502.381137:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972215808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.381216:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972215808:12345-0@lo:400:kworker.0 Request processed in 81us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920502.381222:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1790920502.381294:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972215808:0@lo:400:kworker.0 00000100:00100000:3.0:1790920502.381473:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972216448:0@lo:400:kworker.0 00000001:02000400:3.0:1790920502.398546:0:12268:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:55:01 (1790920501) 00000100:00100000:3.0:1790920502.889515:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972216576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920502.889600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920502.889912:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972216576 00000100:00100000:0.0:1790920502.889921:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972216576 00000100:00100000:0.0:1790920502.889982:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790920502.889992:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972216576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920502.890029:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920502.890086:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972216576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920502.890109:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790920502.890217:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972216576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920502.922778:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920502.922829:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920502.922866:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920502.922962:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951233280 00000100:00100000:1.0:1790920502.922973:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951233280 00000100:00100000:1.0:1790920502.923035:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:1.0:1790920502.923045:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951233280:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920502.923128:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951233280:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920502.923159:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00080000:1.0:1790920502.923183:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920502.923509:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920502.923539:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920502.923564:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951233024 00000100:00100000:3.0:1790920502.923568:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951233024 00000100:00100000:3.0:1790920502.923605:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951233408 00000100:00100000:3.0:1790920502.923608:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951233408 00000100:00100000:3.0:1790920502.923630:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 156 00000100:00100000:3.0:1790920502.923638:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2353:x1877915951233024:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920502.923679:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2353:x1877915951233024:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 42us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920502.923687:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 156 00000100:00100000:3.0:1790920502.923700:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 157 00000100:00100000:3.0:1790920502.923706:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951233408:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920502.923728:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951233408:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 22us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920502.923734:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 157 00000100:00100000:1.0:1790920502.924047:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951233152 00000100:00100000:1.0:1790920502.924052:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951233152 00000100:00100000:1.0:1790920502.924090:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:1.0:1790920502.924096:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951233152:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920502.924131:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951233152:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 35us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920502.924137:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00080000:1.0:1790920502.924153:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790920502.924156:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920502.928948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951232896 00000100:00100000:2.0:1790920502.928964:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951232896 00000100:00100000:2.0:1790920502.929050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 296 00000100:00100000:2.0:1790920502.929062:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951232896:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920502.929662:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951232896:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 600us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920502.929671:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 296 00010000:00010000:3.0:1790920503.340212:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920503.763371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920503.763624:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951233664 00000100:00100000:2.0:1790920503.763635:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951233664 00000100:00100000:2.0:1790920503.763698:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 136 00000100:00100000:2.0:1790920503.763709:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:11282:x1877915951233664:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920503.763730:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920503.763892:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546aa0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac76 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.763983:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.763997:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.764009:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.764025:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.764032:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.764039:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766025:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546aa23 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766045:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766054:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920503.766065:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790920503.766156:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766184:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766192:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766197:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920503.766202:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766209:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766222:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88eb01486600) 00010000:00010000:2.0:1790920503.766225:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920503.766230:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766236:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766250:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766256:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766261:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766266:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920503.766276:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766282:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766290:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920503.766293:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920503.766296:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.766302:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa1c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.767674:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546aa0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac76 expref: 17 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.767697:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546aa23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac76 expref: 16 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.767706:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920503.767709:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920503.767712:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a200, rc 0) 00000100:00100000:2.0:1790920503.768362:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:11282:x1877915951233664:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 4649us (4995us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1790920503.768372:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 136 00000100:00100000:3.0:1790920503.780631:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920503.780787:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920503.781887:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951233792 00000100:00100000:0.0:1790920503.781901:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951233792 00000100:00100000:0.0:1790920503.782022:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 137 00000100:00100000:0.0:1790920503.782033:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:11282:x1877915951233792:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790920503.782166:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:11282:x1877915951233792:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 Request processed in 134us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920503.782174:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 137 00000100:00100000:2.0:1790920503.785043:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951233920 00000100:00100000:2.0:1790920503.785059:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951233920 00000100:00100000:2.0:1790920503.785144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:2.0:1790920503.785154:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+16:2353:x1877915951233920:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920503.785202:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920503.785231:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546aa23 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac76 expref: 16 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920503.785254:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920503.785259:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920503.785334:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:2353:x1877915951233920:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 181us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920503.785341:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000040:00080000:2.0:1790920503.978337:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920503.978347:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920503.982038:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790920503.982073:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1790920504.010119:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1790920504.013764:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1790920504.013783:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1790920504.014093:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1790920504.014105:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1790920504.363071:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920504.426087:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920504.426119:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972216704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920504.426204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920504.426524:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972216704 00000100:00100000:1.0:1790920504.426535:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972216704 00000100:00080000:0.0:1790920504.426654:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920504.426785:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790920504.426808:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972216704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920504.426850:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920504.426926:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972216704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920504.426933:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790920504.427022:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972216704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790920505.386421:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920506.369199:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920506.369334:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951234048 00000100:00100000:2.0:1790920506.369361:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951234048 00000100:00100000:2.0:1790920506.369466:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00100000:2.0:1790920506.369480:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:11325:x1877915951234048:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920506.369511:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920506.369540:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aa31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac7d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.369633:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.369653:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.369670:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.369707:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.369714:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.369720:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370029:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370038:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370044:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370050:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920506.370055:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370062:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370077:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:2.0:1790920506.370081:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920506.370087:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370093:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370117:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370124:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370130:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370136:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920506.370139:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370145:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370153:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88eb2cb2c600) 00010000:00010000:2.0:1790920506.370156:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920506.370159:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370164:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370218:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aa31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac7d expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370229:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:2.0:1790920506.370232:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920506.370245:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aa31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac7d expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.370257:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ac00, rc 0) 00000100:00100000:2.0:1790920506.370357:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:11325:x1877915951234048:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 880us (1175us total) trans 0 rc 301/301 00000100:00100000:2.0:1790920506.370365:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00080000:0.0:1790920506.371573:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920506.378658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.378797:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951234304 00000100:00100000:0.0:1790920506.378813:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951234304 00000100:00100000:0.0:1790920506.378895:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 139 00000100:00100000:0.0:1790920506.378908:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:11325:x1877915951234304:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:0.0:1790920506.378997:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920506.379034:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546a3bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaabd expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.379057:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19d00) 00010000:00010000:0.0:1790920506.379069:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920506.379380:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.379397:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.379410:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.379423:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.379431:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.379438:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920506.380656:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790920506.380679:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.380691:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.380699:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.380707:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920506.380714:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.380723:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.380788:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f600) 00010000:00010000:0.0:1790920506.380792:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920506.380799:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.380806:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa46 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920506.380830:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d857c0d4 reply state 0000000061b78aac transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920506.380841:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790920506.380985:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:11325:x1877915951234304:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 2076us (2337us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1790920506.380995:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 139 00010000:00010000:3.0:1790920506.386675:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.386699:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.386709:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.386716:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920506.386722:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.386731:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.386780:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88eb0856f800) 00010000:00010000:3.0:1790920506.386784:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920506.386791:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.386798:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546aa4d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.412537:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920506.530997:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920506.533905:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951234432 00000100:00100000:3.0:1790920506.533931:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951234432 00000100:00100000:3.0:1790920506.534131:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 140 00000100:00100000:3.0:1790920506.534142:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:11333:x1877915951234432:12345-192.168.204.34@tcp:101:lctl.0 00010000:00010000:3.0:1790920506.534172:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920506.534201:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac84 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.534284:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546aa5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.534301:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546aa5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.534314:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546aa5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920506.534371:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790920506.534376:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920506.534401:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546aa5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.534432:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac84 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.534450:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546aa5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac84 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.534460:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:3.0:1790920506.534463:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920506.534468:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36600, rc 0) 00000100:00100000:3.0:1790920506.534582:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:11333:x1877915951234432:12345-192.168.204.34@tcp:101:lctl.0 Request processed in 441us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920506.534590:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 140 00000100:00100000:1.0:1790920506.615196:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.615880:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951234560 00000100:00100000:0.0:1790920506.615895:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951234560 00000100:00100000:0.0:1790920506.616014:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 141 00000100:00100000:0.0:1790920506.616027:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:11339:x1877915951234560:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920506.616057:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920506.616086:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac8b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616171:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616189:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616222:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616247:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616254:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616260:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616547:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546aa77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616572:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616588:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920506.616718:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790920506.616722:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920506.616743:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616798:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616805:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616830:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616837:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920506.616841:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616849:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616862:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:0.0:1790920506.616866:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920506.616871:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616878:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546aa69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616893:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616898:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616904:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616909:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920506.616913:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616927:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616935:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88eb0856f600) 00010000:00010000:0.0:1790920506.616937:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920506.616940:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616945:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aa70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616983:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aa62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac8b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.616996:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546aa77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac8b expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.617002:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920506.617004:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790920506.617006:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52400, rc 0) 00000100:00100000:0.0:1790920506.620542:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:11339:x1877915951234560:12345-192.168.204.34@tcp:101:bash.0 Request processed in 4505us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920506.620557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 141 00000100:00100000:1.0:1790920506.626159:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920506.626399:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951234816 00000100:00100000:2.0:1790920506.626412:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951234816 00000100:00100000:2.0:1790920506.626549:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 142 00000100:00100000:2.0:1790920506.626561:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:11339:x1877915951234816:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1790920506.626589:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920506.626618:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aa7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac92 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.626827:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.626846:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.626860:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.626878:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.626886:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.626894:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920506.627743:0:11700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1790920506.628108:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628124:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628135:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628178:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628186:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628194:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628201:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920506.628207:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628215:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628229:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920506.628233:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920506.628239:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628260:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546aa85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920506.628277:0:11700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007083e010 reply state 00000000098216d7 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920506.628289:0:11700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790920506.628332:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aa7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628362:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 17 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.628380:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:3.0:1790920506.628383:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920506.628385:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37c00, rc 0) 00000100:00100000:3.0:1790920506.628496:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11339:x1877915951234816:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1937us (2352us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1790920506.628507:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 142 00010000:00010000:2.0:1790920506.631563:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.631589:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.631598:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.631605:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920506.631611:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.631620:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.631643:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb2cb2c600) 00010000:00010000:2.0:1790920506.631646:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920506.631654:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.631661:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546aa8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920506.633256:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.634694:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951234944 00000100:00100000:0.0:1790920506.634716:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951234944 00000100:00100000:0.0:1790920506.634966:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:0.0:1790920506.634980:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2352:x1877915951234944:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920506.635029:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920506.635061:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edac99 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790920506.635099:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920506.635127:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1790920506.635133:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920506.635147:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.635174:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.635195:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52e00, rc 0) 00000100:00100000:0.0:1790920506.635296:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2352:x1877915951234944:12345-192.168.204.34@tcp:101:bash.0 Request processed in 319us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920506.635305:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00080000:1.0:1790920506.638069:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790920506.638451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920506.638543:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951235072 00000100:00100000:1.0:1790920506.638558:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951235072 00000100:00100000:1.0:1790920506.638640:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:1.0:1790920506.638653:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:11339:x1877915951235072:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920506.638683:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920506.638711:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaca0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.638788:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.638798:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920506.638803:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920506.638808:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.638854:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.638871:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 7 pid: 6690 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920506.638887:0:8267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1877915972216832:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920506.639020:0:8267:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1790920506.641845:0:8267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1877915972216832:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920506.641899:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 7 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.641924:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d400, rc 0) 00000100:00100000:0.0:1790920506.643813:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:11339:x1877915951235072:12345-192.168.204.34@tcp:101:bash.0 Request processed in 5147us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920506.643830:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:1.0:1790920506.647082:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.648365:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951235200 00000100:00100000:0.0:1790920506.648384:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951235200 00010000:00010000:0.0:1790920506.648450:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 7 pid: 6690 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920506.648524:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:0.0:1790920506.648536:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951235200:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920506.648555:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920506.648588:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 7 pid: 6690 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.648603:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 7 pid: 6690 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.648646:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546aaa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac99 expref: 7 pid: 6690 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.648668:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920506.648674:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920506.648684:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.648695:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.648782:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920506.648826:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1877915972216960:192.168.204.34@tcp:105: 00000100:00100000:0.0:1790920506.648966:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920506.658728:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.658803:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1877915972216960:192.168.204.34@tcp:105: 00010000:00010000:0.0:1790920506.658836:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920506.658862:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951235456 00000100:00100000:1.0:1790920506.658871:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951235456 00000100:00100000:0.0:1790920506.658914:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951235200:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 10380us (11847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920506.658925:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:1.0:1790920506.658947:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:1.0:1790920506.659625:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11339:x1877915951235456:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:1.0:1790920506.660379:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11339:x1877915951235456:12345-192.168.204.34@tcp:35:bash.0 Request processed in 1419us (1664us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1790920506.660391:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:2.0:1790920506.767275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920506.767453:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951235712 00000100:00100000:1.0:1790920506.767588:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951235712 00000100:00100000:1.0:1790920506.767668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 143 00000100:00100000:1.0:1790920506.767681:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11349:x1877915951235712:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920506.767716:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920506.767894:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aaaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaca7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920506.768091:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790920506.768261:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aaaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca7 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.768279:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:1.0:1790920506.768282:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920506.768288:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aaaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca7 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.768312:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d800, rc 0) 00000100:00100000:1.0:1790920506.768409:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:11349:x1877915951235712:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 730us (1150us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1790920506.768417:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 143 00000100:00100000:2.0:1790920506.774557:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920506.774651:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951235968 00000100:00100000:3.0:1790920506.774666:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951235968 00000100:00100000:3.0:1790920506.774739:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:3.0:1790920506.775001:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:11349:x1877915951235968:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1790920506.775331:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11349:x1877915951235968:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 581us (787us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1790920506.775351:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:2.0:1790920506.893935:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920506.894496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951236096 00000100:00100000:3.0:1790920506.894519:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951236096 00000100:00100000:3.0:1790920506.894603:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 144 00000100:00100000:3.0:1790920506.894616:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11355:x1877915951236096:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920506.894651:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920506.894682:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546aabd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.894821:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.894839:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.894856:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920506.894904:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790920506.894908:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920506.894932:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.895165:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546aabd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacae expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.895189:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacae expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920506.895199:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920506.895202:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920506.895206:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37200, rc 0) 00000100:00100000:3.0:1790920506.895305:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:11355:x1877915951236096:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 692us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920506.895313:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 144 00000100:00100000:2.0:1790920506.901037:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.901960:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951236352 00000100:00100000:0.0:1790920506.901978:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951236352 00000100:00100000:0.0:1790920506.902066:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 145 00000100:00100000:0.0:1790920506.902078:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:11355:x1877915951236352:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920506.902110:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920506.902139:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aacb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacb5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.902284:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.902303:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.902321:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920506.902348:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790920506.903611:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546aacb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacb5 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.903668:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacb5 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.903680:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:0.0:1790920506.903683:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920506.903689:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53400, rc 0) 00000100:00100000:0.0:1790920506.903958:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:11355:x1877915951236352:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1880us (2934us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790920506.903968:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 145 00000100:00100000:2.0:1790920506.908318:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920506.908453:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.908571:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951236480 00000100:00100000:0.0:1790920506.908585:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951236480 00000100:00100000:0.0:1790920506.908669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1790920506.908683:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:2352:x1877915951236480:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920506.908704:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920506.908739:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546aad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacb5 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.908790:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:0.0:1790920506.908998:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920506.909075:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:2352:x1877915951236480:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 394us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920506.909084:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1790920506.910920:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951236736 00000100:00100000:1.0:1790920506.911025:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951236736 00000100:00100000:1.0:1790920506.911149:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 146 00000100:00100000:1.0:1790920506.911162:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:11355:x1877915951236736:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920506.911197:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920506.911226:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aae0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacbc expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.911382:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546aae7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.911401:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546aae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.911415:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546aae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920506.911430:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790920506.911622:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aae0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacbc expref: 25 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.911645:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546aae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacbc expref: 24 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.911656:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:1.0:1790920506.911659:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790920506.911663:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c400, rc 0) 00000100:00100000:1.0:1790920506.912080:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:11355:x1877915951236736:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 919us (3625us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1790920506.912088:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 146 00000100:00100000:0.0:1790920506.917703:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920506.918084:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951236864 00000100:00100000:1.0:1790920506.918097:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951236864 00000100:00100000:1.0:1790920506.918177:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1790920506.918190:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951236864:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:1.0:1790920506.918270:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.918298:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.918308:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790920506.918313:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920506.918318:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.918391:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 6 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.918408:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 6 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920506.918427:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877915972217088:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920506.918566:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920506.922134:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.922227:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951236992 00000100:00100000:0.0:1790920506.922243:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951236992 00002000:00100000:0.0:1790920506.922352:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88eb34251500 x1877915951236992/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:117/0 lens 504/0 e 0 to 0 dl 1790920517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790920506.922373:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb34251500 with x1877915951236992 ext(0->12) 00010000:00010000:0.0:1790920506.922384:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 7 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.922404:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 7 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790920506.922412:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb34251500 00000100:00100000:0.0:1790920506.922493:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:0.0:1790920506.922505:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951236992:12345-192.168.204.34@tcp:4:lfs.0 00000100:00100000:0.0:1790920506.923497:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951236992:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 985us (1373us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790920506.923510:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00002000:00100000:0.0:1790920506.923521:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88eb34251500 x1877915951236992/t4294967305(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:117/0 lens 504/448 e 0 to 0 dl 1790920517 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790920506.923530:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb34251500 with x1877915951236992 ext(0->12) 00010000:00010000:0.0:1790920506.923539:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 9 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920506.923558:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 9 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790920506.923567:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb34251500 00000100:00100000:1.0:1790920506.924654:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877915972217088:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920506.924692:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920506.927502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920506.928614:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951237120 00000100:00100000:1.0:1790920506.928634:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951237120 00010000:00010000:1.0:1790920506.928694:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 9 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920506.928834:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:1.0:1790920506.928846:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2352:x1877915951237120:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920506.928866:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790920506.928892:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790920506.928896:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790920506 00002000:00010000:1.0:1790920506.928898:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790920507 00002000:00010000:1.0:1790920506.928901:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790920506 00010000:00010000:1.0:1790920506.928908:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 9 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.928923:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 9 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.928969:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1c2bd29/0x2a4915844546aaa8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaca0 expref: 9 pid: 8267 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.928993:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920506.928997:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790920506.929004:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.929041:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.929077:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920506.929164:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2352:x1877915951237120:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 320us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920506.929172:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00010000:00010000:2.0:1790920506.929236:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929247:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929277:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929287:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929296:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929304:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c800 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920506.929309:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929319:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929344:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.929369:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a8ed56c/0x2a4915844546aaf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920506.929425:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951236864:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 11239us (11740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920506.929435:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:3.0:1790920506.933304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920506.933559:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951237376 00000100:00100000:0.0:1790920506.933572:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951237376 00000100:00100000:0.0:1790920506.933678:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:0.0:1790920506.933692:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:11355:x1877915951237376:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:2.0:1790920506.934166:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546aae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacbc expref: 24 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790920506.934667:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1790920506.934731:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1790920506.936315:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1790920506.936652:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.936680:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 28 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.936689:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.936740:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 28 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.937060:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 28 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920506.937097:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972217216:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920506.937236:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41e5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1790920506.942208:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920506.942396:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972217216:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920506.942439:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920506.942612:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951237504 00000100:00100000:1.0:1790920506.942622:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951237504 00010000:00010000:1.0:1790920506.942672:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 29 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920506.942774:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:1.0:1790920506.942787:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:2354:x1877915951237504:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920506.942885:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920506.942895:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 29 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.942911:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 29 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.942941:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aa93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac92 expref: 29 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.943030:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:1.0:1790920506.943056:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.943068:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.943077:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.943112:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920506.943246:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:2354:x1877915951237504:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 460us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920506.943254:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00010000:00010000:2.0:1790920506.943389:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.943398:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790920506.943578:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1790920506.943879:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1790920506.944028:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972217344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790920506.944105:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920506.944213:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41e5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1790920506.946444:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972217344 00000100:00100000:0.0:1790920506.946466:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972217344 00000100:00100000:0.0:1790920506.946561:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790920506.946572:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877915972217344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920506.946724:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877915972217344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 153us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920506.946732:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790920506.947048:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972217344:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1790920506.948019:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1790920506.948170:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1790920506.948300:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972217472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790920506.948508:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920506.948544:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb41e5e180 going to sleep for 11 seconds 00000100:00100000:0.0:1790920506.948613:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972217472 00000100:00100000:0.0:1790920506.948624:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972217472 00000100:00100000:0.0:1790920506.948685:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790920506.948696:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1877915972217472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920506.949236:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1877915972217472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 539us (727us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790920506.949246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790920506.949381:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34250700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972217472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790920506.949465:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1790920506.949518:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.949544:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.949554:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.949560:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56bc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920506.949566:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.949575:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.949595:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:2.0:1790920506.949598:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790920506.949605:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920506.949611:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aafc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920506.950321:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790920506.950715:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1790920506.950732:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349116983883ns, next at 350116980315ns, rc = 0 00000001:00080000:2.0:1790920506.950743:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1790920506.951530:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:2.0:1790920506.951535:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790920506.951549:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c400/0x2a4915844546aae7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacbc expref: 32 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920506.951742:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:11355:x1877915951237376:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 18053us (18453us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1790920506.951786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000020:00080000:2.0:1790920506.954297:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790920506.955166:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920506.955397:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951237632 00000100:00100000:1.0:1790920506.955412:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951237632 00000100:00100000:1.0:1790920506.955485:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 147 00000100:00100000:1.0:1790920506.955499:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:11355:x1877915951237632:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920506.955533:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920506.955566:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ab03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacc3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.955650:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ab03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacc3 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.955668:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ab03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacc3 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920506.955693:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920506.955716:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790920506.955721:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d400, rc 0) 00000100:00100000:2.0:1790920506.956469:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:11355:x1877915951237632:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 967us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920506.956480:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 147 00000100:00100000:0.0:1790920506.961743:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920506.962118:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951237888 00000100:00100000:3.0:1790920506.962134:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951237888 00000100:00100000:3.0:1790920506.962219:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:3.0:1790920506.962233:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:11355:x1877915951237888:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1790920506.962683:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:11355:x1877915951237888:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 451us (954us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1790920506.962692:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:3.0:1790920507.070899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920507.071098:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951238144 00000100:00100000:2.0:1790920507.071111:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951238144 00000100:00100000:2.0:1790920507.071186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 148 00000100:00100000:2.0:1790920507.071199:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+33:11365:x1877915951238144:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920507.071233:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920507.071261:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920507.071522:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790920507.071683:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacca expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.071702:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:2.0:1790920507.071706:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790920507.071712:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacca expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.071731:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56bc00, rc 0) 00000100:00100000:2.0:1790920507.071863:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11365:x1877915951238144:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 665us (978us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1790920507.071888:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 148 00000100:00100000:1.0:1790920507.075404:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920507.075611:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951238272 00000100:00100000:3.0:1790920507.075624:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951238272 00000100:00100000:3.0:1790920507.075703:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 149 00000100:00100000:3.0:1790920507.075715:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11365:x1877915951238272:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:3.0:1790920507.075874:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.075895:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.075907:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.075942:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.075949:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.075955:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.076055:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.076064:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.076072:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920507.076118:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.076130:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.076135:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.076142:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.076147:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920507.076151:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079540:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079564:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920507.079567:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920507.079574:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079581:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ab18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079599:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079606:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079612:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079618:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920507.079622:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079628:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079634:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb04d19200) 00010000:00010000:3.0:1790920507.079637:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920507.079640:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079665:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546ab1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079686:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079691:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079696:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079701:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920507.079704:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079709:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079716:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:3.0:1790920507.079718:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920507.079722:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.079727:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ab26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920507.079962:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11365:x1877915951238272:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 4245us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920507.079972:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 149 00000100:00100000:1.0:1790920507.085845:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920507.086478:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951238528 00000100:00100000:3.0:1790920507.086495:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951238528 00000100:00100000:3.0:1790920507.086579:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:3.0:1790920507.086591:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11365:x1877915951238528:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1790920507.086989:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:11365:x1877915951238528:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 399us (1157us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1790920507.086997:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:0.0:1790920507.177005:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920507.177387:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951238784 00000100:00100000:1.0:1790920507.177402:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951238784 00000100:00100000:1.0:1790920507.177478:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 150 00000100:00100000:1.0:1790920507.177490:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:11368:x1877915951238784:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920507.177528:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920507.177559:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546ab2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacd1 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.177666:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.177685:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.177700:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.177934:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.177956:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.177963:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178121:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178148:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178155:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920507.178296:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790920507.178871:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178882:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178890:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178897:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443de00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920507.178902:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178911:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.178927:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:1.0:1790920507.178931:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920507.179129:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179141:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ab34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179240:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179261:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179267:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179272:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ce00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920507.179276:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179282:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179291:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb01486800) 00010000:00010000:1.0:1790920507.179295:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920507.179299:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179305:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ab3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179500:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546ab2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 38 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179519:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 37 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920507.179527:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920507.179530:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920507.179538:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443cc00, rc 0) 00000100:00100000:1.0:1790920507.179712:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:11368:x1877915951238784:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2223us (2721us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790920507.179731:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 150 00000100:00100000:1.0:1790920507.185634:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920507.185782:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951238912 00000100:00100000:2.0:1790920507.185797:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951238912 00000100:00100000:2.0:1790920507.185875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00100000:2.0:1790920507.185888:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:11368:x1877915951238912:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1790920507.185990:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186013:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186028:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186063:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186072:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186081:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186089:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56bc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920507.186095:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186105:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186120:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920507.186142:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790920507.186149:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.186157:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920507.186275:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:11368:x1877915951238912:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 388us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920507.186284:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00100000:0.0:1790920507.189570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920507.189693:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951239168 00000100:00100000:3.0:1790920507.189708:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951239168 00000100:00100000:3.0:1790920507.189832:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:3.0:1790920507.189845:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:11368:x1877915951239168:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1790920507.190184:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:11368:x1877915951239168:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 341us (627us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1790920507.190193:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00010000:00010000:3.0:1790920507.435614:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920507.497578:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972217728:0@lo:400:kworker.0 00000100:00100000:1.0:1790920507.497682:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920507.497894:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972217984:0@lo:400:kworker.0 00000100:00100000:3.0:1790920507.497961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920507.498044:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920507.498051:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972217856:0@lo:400:kworker.0 00000100:00100000:1.0:1790920507.498079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920507.498383:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972217600:0@lo:400:kworker.0 00000100:00100000:0.0:1790920507.498424:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920507.498891:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972217984 00000100:00100000:3.0:1790920507.498904:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972217984 00000100:00100000:3.0:1790920507.498988:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790920507.499001:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972217984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920507.499084:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972217984:12345-0@lo:400:kworker.0 Request processed in 85us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920507.499092:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1790920507.499115:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920507.501337:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972217728 00000100:00100000:3.0:1790920507.501370:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972217728 00000100:00100000:3.0:1790920507.501434:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972217856 00000100:00100000:3.0:1790920507.501438:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972217856 00000100:00080000:3.0:1790920507.501643:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920507.501679:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790920507.501690:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972217728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920507.501918:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972217728:12345-0@lo:400:kworker.0 Request processed in 229us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920507.501925:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790920507.501947:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790920507.501953:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972217856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920507.501984:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972217856:12345-0@lo:400:kworker.0 Request processed in 32us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920507.501990:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790920507.502056:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972217600 00000100:00100000:3.0:1790920507.502244:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972217600 00000100:00100000:3.0:1790920507.502282:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1790920507.502289:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972217600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920507.502342:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972217600:12345-0@lo:400:kworker.0 Request processed in 53us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920507.502348:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790920507.502578:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972217856:0@lo:400:kworker.0 00000100:00100000:1.0:1790920507.502598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972217728:0@lo:400:kworker.0 00000100:00100000:2.0:1790920507.508153:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1790920507.508173:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb3af12d80, transno 4294967312 00000100:00100000:2.0:1790920507.508201:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972217984:0@lo:400:kworker.0 00000100:00100000:0.0:1790920507.508399:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972217600:0@lo:400:kworker.0 00000100:00100000:0.0:1790920507.508414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972218112:0@lo:400:kworker.0 00000100:00100000:0.0:1790920507.508533:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920507.508603:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972218112 00000100:00100000:0.0:1790920507.508613:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972218112 00000100:00080000:0.0:1790920507.508646:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920507.508695:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790920507.508704:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972218112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920507.508778:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972218112:12345-0@lo:400:kworker.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920507.508799:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790920507.508839:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972218112:0@lo:400:kworker.0 00000100:00100000:0.0:1790920507.573199:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920507.576691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951239424 00000100:00100000:2.0:1790920507.576713:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951239424 00000100:00100000:2.0:1790920507.576836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 152 00000100:00100000:2.0:1790920507.576849:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:11399:x1877915951239424:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:2.0:1790920507.576884:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920507.576913:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacd8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.577057:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546ab5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.577078:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546ab5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.577094:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546ab5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920507.577131:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790920507.577317:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546ab57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd8 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.577351:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546ab5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd8 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.577361:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920507.577364:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920507.577368:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56be00, rc 0) 00000100:00100000:2.0:1790920507.577470:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:11399:x1877915951239424:12345-192.168.204.34@tcp:101:cat.0 Request processed in 623us (4281us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1790920507.577479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 152 00000100:00100000:1.0:1790920507.584349:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920507.584500:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951239552 00000100:00100000:0.0:1790920507.584520:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951239552 00000100:00100000:0.0:1790920507.584616:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1790920507.584628:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:2355:x1877915951239552:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920507.584647:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920507.584680:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546ab5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd8 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.584704:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920507.584710:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920507.584823:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:2355:x1877915951239552:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 196us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920507.584831:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:1.0:1790920507.586836:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920507.587160:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951239808 00000100:00100000:3.0:1790920507.587176:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951239808 00000100:00100000:3.0:1790920507.587254:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:3.0:1790920507.587265:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:11399:x1877915951239808:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:3.0:1790920507.587695:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:11399:x1877915951239808:12345-192.168.204.34@tcp:35:cat.0 Request processed in 430us (882us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1790920507.587720:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000001:00080000:1.0:1790920507.612208:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1790920507.612232:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1790920507.688330:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920507.688642:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951240064 00000100:00100000:0.0:1790920507.688656:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951240064 00000100:00100000:0.0:1790920507.688817:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 153 00000100:00100000:0.0:1790920507.688830:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:11405:x1877915951240064:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:0.0:1790920507.688865:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920507.688869:0:11700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790920507.688906:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacae expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.689428:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920507.689438:0:11700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920507.689471:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacdf expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.689619:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.689638:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 40 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.689648:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.689696:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 40 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.689711:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 40 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920507.689728:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972218240:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920507.689911:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd840 going to sleep for 11 seconds 00000100:00100000:0.0:1790920507.694502:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972218240:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920507.694550:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920507.699838:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920507.700932:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951240192 00000100:00100000:0.0:1790920507.700954:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951240192 00010000:00010000:0.0:1790920507.701024:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 41 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920507.701078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:0.0:1790920507.701089:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+41:2353:x1877915951240192:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920507.701109:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920507.701117:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 41 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.701133:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 41 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.701164:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546ab42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacd1 expref: 41 pid: 11700 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.701187:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920507.701193:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.701203:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.701237:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920507.701284:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920507.701381:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:2353:x1877915951240192:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 293us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920507.701389:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00010000:00010000:3.0:1790920507.701469:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.701480:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920507.701506:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790920507.701731:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 41 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.701810:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 40 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.701819:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:3.0:1790920507.701822:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790920507.701825:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52c00, rc 0) 00000100:00100000:3.0:1790920507.701859:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:11405:x1877915951240064:12345-192.168.204.34@tcp:101:dd.0 Request processed in 13032us (13557us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1790920507.701866:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 153 00000100:00100000:1.0:1790920507.705057:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920507.705289:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951240448 00000100:00100000:2.0:1790920507.705303:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951240448 00000100:00100000:2.0:1790920507.705418:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 154 00000100:00100000:2.0:1790920507.705430:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:11405:x1877915951240448:12345-192.168.204.34@tcp:36:dd.0 00010000:00010000:2.0:1790920507.705859:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.705883:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920507.705898:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790920507.706096:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1790920507.706147:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efc27aea reply state 00000000dd06c449 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920507.706282:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920507.706919:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:11405:x1877915951240448:12345-192.168.204.34@tcp:36:dd.0 Request processed in 1484us (1871us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1790920507.706942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 154 00000020:00080000:2.0:1790920507.706951:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790920507.711899:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.711923:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.711932:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.711974:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920507.711981:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.711989:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.712016:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:3.0:1790920507.712019:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920507.712026:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920507.712033:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ab81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920508.009330:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972218368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920508.009437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920508.009742:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972218368 00000100:00100000:2.0:1790920508.009952:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972218368 00000100:00100000:2.0:1790920508.010024:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790920508.010036:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972218368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920508.010084:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920508.010306:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972218368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 271us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920508.010326:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790920508.010513:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972218368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920508.033439:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.038162:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951240576 00000100:00100000:0.0:1790920508.038185:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951240576 00000100:00100000:0.0:1790920508.038333:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 155 00000100:00100000:0.0:1790920508.038348:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+42:11419:x1877915951240576:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:0.0:1790920508.038379:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920508.038409:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546ab88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edace6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038501:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038519:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038535:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038552:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038559:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038591:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790920508.038680:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790920508.038710:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038722:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 43 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038730:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038816:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 43 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.038834:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 43 pid: 11700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920508.038850:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972218496:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920508.038995:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd840 going to sleep for 11 seconds 00000100:00100000:1.0:1790920508.041346:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920508.041560:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951240832 00000100:00100000:3.0:1790920508.041573:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951240832 00000100:00100000:3.0:1790920508.041653:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:3.0:1790920508.041666:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+44:5593:x1877915951240832:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790920508.042167:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:5593:x1877915951240832:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 501us (839us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1790920508.042177:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:0.0:1790920508.044190:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41826a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972218496:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920508.044233:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920508.044290:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920508.044387:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920508.044430:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920508.044468:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.044496:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951241344 00000100:00100000:0.0:1790920508.044505:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951241344 00000100:00100000:1.0:1790920508.044532:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951240960 00000100:00100000:1.0:1790920508.044537:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951240960 00000100:00100000:1.0:1790920508.044574:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 298 00000100:00100000:0.0:1790920508.044574:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 161 00000100:00100000:1.0:1790920508.044584:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951240960:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920508.044584:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951241344:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920508.044688:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951240960:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 105us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920508.044697:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 298 00000100:00100000:0.0:1790920508.051871:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951241344:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 7268us (7463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920508.051890:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 161 00000100:00080000:0.0:1790920508.051957:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920508.055200:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.055430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951241472 00000100:00100000:0.0:1790920508.055446:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951241472 00010000:00010000:0.0:1790920508.055500:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 45 pid: 11700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920508.055557:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:0.0:1790920508.055568:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:2354:x1877915951241472:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920508.055590:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920508.055599:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 45 pid: 11700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.055615:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 45 pid: 11700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.055644:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ab73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacdf expref: 45 pid: 11700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.055665:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920508.055671:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.055683:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.055716:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.055808:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920508.055877:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+44:2354:x1877915951241472:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 309us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920508.055885:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00010000:00010000:0.0:1790920508.059094:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059119:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920508.059304:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790920508.059321:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920508.059427:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059449:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059463:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059472:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059481:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059489:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920508.059515:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059525:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059546:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920508.059549:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920508.059556:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059563:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ab8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059580:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059588:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059594:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059600:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920508.059603:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059610:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059618:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb0856f500) 00010000:00010000:0.0:1790920508.059620:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920508.059628:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059635:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546ab96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059690:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546ab88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edace6 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059707:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edace6 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.059716:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920508.059719:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920508.059721:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53000, rc 0) 00000100:00100000:0.0:1790920508.061105:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:11419:x1877915951240576:12345-192.168.204.34@tcp:101:stat.0 Request processed in 22749us (27670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920508.061120:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 155 00000100:00100000:2.0:1790920508.066045:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951241088 00000100:00100000:2.0:1790920508.066073:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951241088 00000100:00080000:2.0:1790920508.066159:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920508.066228:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951241216 00000100:00100000:2.0:1790920508.066233:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951241216 00000100:00100000:2.0:1790920508.066276:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:2.0:1790920508.066288:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951241088:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920508.066544:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2353:x1877915951241088:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 256us (22254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920508.066552:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:2.0:1790920508.066584:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:2.0:1790920508.066591:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951241216:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920508.066642:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951241216:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 52us (22174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920508.066649:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00080000:2.0:1790920508.066667:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1790920508.073113:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920508.073131:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920508.073723:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1790920508.073734:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790920508.158635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.158823:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951241728 00000100:00100000:1.0:1790920508.158837:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951241728 00000100:00100000:1.0:1790920508.158909:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 156 00000100:00100000:1.0:1790920508.158921:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:11425:x1877915951241728:12345-192.168.204.34@tcp:36:truncate.0 00010000:00010000:1.0:1790920508.159001:0:11700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920508.159038:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546ab9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edace6 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.159067:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920508.159075:0:11700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920508.159599:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.159620:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.159632:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920508.159697:0:11700:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1790920508.159726:0:11700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034697c57 reply state 0000000045028f27 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920508.159737:0:11700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790920508.160054:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:11425:x1877915951241728:12345-192.168.204.34@tcp:36:truncate.0 Request processed in 1133us (1433us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1790920508.160086:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 156 00000020:00080000:1.0:1790920508.160094:0:11700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790920508.167219:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.167246:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.167254:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.167261:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920508.167268:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.167277:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.167300:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920508.167303:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920508.167321:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.167329:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546aba4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920508.298451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920508.298601:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951241856 00000100:00100000:2.0:1790920508.298615:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951241856 00000100:00100000:2.0:1790920508.298694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 157 00000100:00100000:2.0:1790920508.298707:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+44:11439:x1877915951241856:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:2.0:1790920508.298740:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920508.298809:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546abab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaced expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.298904:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299050:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299066:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299084:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299091:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299098:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299289:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299299:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299347:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920508.299394:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1790920508.299400:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920508.299425:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299444:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299453:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299460:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299468:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299475:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920508.299480:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299489:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299504:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920508.299508:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920508.299514:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299533:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546abb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299552:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299559:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299565:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299570:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920508.299573:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299579:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299587:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb2cb2c600) 00010000:00010000:2.0:1790920508.299590:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920508.299592:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299598:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299644:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546abab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299660:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.299673:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920508.299676:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920508.299678:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ae00, rc 0) 00000100:00100000:2.0:1790920508.300087:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:11439:x1877915951241856:12345-192.168.204.34@tcp:101:stat.0 Request processed in 1380us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920508.300096:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 157 00000100:00100000:0.0:1790920508.378225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.378351:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951242112 00000100:00100000:1.0:1790920508.378365:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951242112 00000100:00100000:1.0:1790920508.378448:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 158 00000100:00100000:1.0:1790920508.378461:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+45:11449:x1877915951242112:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920508.378492:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920508.378522:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546abc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacf4 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920508.378987:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790920508.379171:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546abc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacf4 expref: 47 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.379189:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:1.0:1790920508.379193:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920508.379199:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546abc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacf4 expref: 47 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.379221:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443ce00, rc 0) 00000100:00100000:1.0:1790920508.379322:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+46:11449:x1877915951242112:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 863us (1111us total) trans 4294967446 rc 301/301 00000100:00100000:1.0:1790920508.379339:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 158 00000100:00100000:1.0:1790920508.386089:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920508.387243:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951242368 00000100:00100000:3.0:1790920508.387260:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951242368 00000100:00100000:3.0:1790920508.388409:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:3.0:1790920508.388439:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+46:11449:x1877915951242368:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1790920508.389130:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:11449:x1877915951242368:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 699us (3049us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1790920508.389539:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00010000:00010000:3.0:1790920508.458494:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920508.471023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920508.471196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951242624 00000100:00100000:2.0:1790920508.471210:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951242624 00000100:00100000:2.0:1790920508.471289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 159 00000100:00100000:2.0:1790920508.471317:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:11455:x1877915951242624:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1790920508.471584:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920508.471617:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546abd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edacfb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.471814:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.471832:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.471842:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.471885:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.471901:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 48 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920508.472006:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972218624:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920508.472134:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790920508.475450:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.475828:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951242752 00000100:00100000:1.0:1790920508.475842:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951242752 00010000:00010000:1.0:1790920508.475896:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 49 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920508.475974:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:1.0:1790920508.475986:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:2355:x1877915951242752:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920508.476005:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920508.476013:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 49 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.476027:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 49 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.476057:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920508.476062:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.476074:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.476083:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.476107:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920508.476300:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+49:2355:x1877915951242752:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 314us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920508.476318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 65 00010000:00010000:2.0:1790920508.476880:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546abc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaced expref: 48 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920508.476904:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972218624:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920508.476945:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.476957:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.476963:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920508.476990:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1790920508.477202:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546abd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.477220:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920508.477229:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:2.0:1790920508.477232:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790920508.477236:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b800, rc 0) 00000100:00100000:2.0:1790920508.477283:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:11455:x1877915951242624:12345-192.168.204.34@tcp:101:bash.0 Request processed in 5984us (6275us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1790920508.477316:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 159 00000100:00100000:1.0:1790920508.481974:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.482076:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951243008 00000100:00100000:0.0:1790920508.482089:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951243008 00000100:00100000:0.0:1790920508.482186:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 160 00000100:00100000:0.0:1790920508.482197:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:11455:x1877915951243008:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:0.0:1790920508.482822:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.482862:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.482878:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920508.483091:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1790920508.483120:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba31109e reply state 00000000f980e354 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920508.483130:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790920508.483325:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:11455:x1877915951243008:12345-192.168.204.34@tcp:36:bash.0 Request processed in 1127us (1421us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1790920508.483334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 160 00000020:00080000:0.0:1790920508.483341:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790920508.491940:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.492359:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951243136 00000100:00100000:0.0:1790920508.492384:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951243136 00000100:00100000:0.0:1790920508.492476:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 161 00000100:00100000:0.0:1790920508.492489:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:11455:x1877915951243136:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920508.492523:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920508.492555:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546abf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad02 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.492677:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.492696:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.492730:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.492740:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.492801:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.492837:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.492854:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 52 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920508.492871:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af11880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972218752:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920508.492991:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cddf00 going to sleep for 11 seconds 00010000:00010000:1.0:1790920508.496215:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.496259:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.496267:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.496274:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920508.496279:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.496288:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.496320:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920508.496323:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920508.496327:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.496349:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.496355:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546abea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920508.497293:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.497621:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af11880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972218752:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920508.497659:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920508.497723:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951243264 00000100:00100000:1.0:1790920508.497733:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951243264 00010000:00010000:0.0:1790920508.498018:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 52 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920508.498115:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:0.0:1790920508.498128:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:2354:x1877915951243264:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920508.498164:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920508.498172:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 52 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.498186:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 52 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.498211:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546abdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacfb expref: 52 pid: 5846 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.498229:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920508.498234:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.498244:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.498254:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.498289:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920508.498617:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:2354:x1877915951243264:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 489us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920508.498626:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 66 00010000:00010000:1.0:1790920508.498928:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.498938:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920508.499014:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790920508.499020:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920508.499046:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.499087:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546abf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad02 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.499108:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad02 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.499116:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920508.499120:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920508.499123:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53400, rc 0) 00000100:00100000:1.0:1790920508.499170:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+50:11455:x1877915951243136:12345-192.168.204.34@tcp:101:bash.0 Request processed in 6685us (7247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920508.499177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 161 00000100:00100000:2.0:1790920508.503254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.503382:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951243520 00000100:00100000:1.0:1790920508.503396:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951243520 00000100:00100000:1.0:1790920508.503471:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:1.0:1790920508.503484:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+50:11455:x1877915951243520:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:1.0:1790920508.503850:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:11455:x1877915951243520:12345-192.168.204.34@tcp:35:bash.0 Request processed in 367us (609us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1790920508.503859:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:2.0:1790920508.582017:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.582138:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951243776 00000100:00100000:1.0:1790920508.582152:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951243776 00000100:00100000:1.0:1790920508.582288:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 162 00000100:00100000:1.0:1790920508.582311:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:11465:x1877915951243776:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920508.582346:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920508.582384:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546abff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad09 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920508.582507:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790920508.582895:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546abff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad09 expref: 53 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.582923:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:1.0:1790920508.582928:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920508.582934:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546abff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad09 expref: 53 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.582953:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443ce00, rc 0) 00000100:00100000:1.0:1790920508.583078:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11465:x1877915951243776:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 780us (1076us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1790920508.583087:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 162 00000100:00100000:2.0:1790920508.590158:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.591994:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951243904 00000100:00100000:0.0:1790920508.592019:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951243904 00000100:00100000:0.0:1790920508.592121:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 163 00000100:00100000:0.0:1790920508.592135:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11465:x1877915951243904:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:0.0:1790920508.592271:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592295:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592321:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592339:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592346:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592354:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592480:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592489:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592496:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920508.592710:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592728:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592811:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592820:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592827:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920508.592833:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592841:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592858:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920508.592861:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920508.592868:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592875:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592892:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592898:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592903:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592908:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920508.592916:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592924:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592932:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb0856f600) 00010000:00010000:0.0:1790920508.592935:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920508.592937:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592943:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592960:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592966:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592972:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592976:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920508.592978:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592984:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.592991:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920508.592994:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920508.593005:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.593011:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920508.593113:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11465:x1877915951243904:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 979us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920508.593123:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 163 00000100:00100000:2.0:1790920508.596948:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.597068:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951244160 00000100:00100000:1.0:1790920508.597083:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951244160 00000100:00100000:1.0:1790920508.597396:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:1.0:1790920508.597409:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11465:x1877915951244160:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920508.597819:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:11465:x1877915951244160:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 411us (885us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1790920508.597829:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:2.0:1790920508.653065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.653193:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951244416 00000100:00100000:0.0:1790920508.653207:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951244416 00000100:00100000:0.0:1790920508.653345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 164 00000100:00100000:0.0:1790920508.653358:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+53:11468:x1877915951244416:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920508.653402:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920508.653431:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad10 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653543:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653575:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653591:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653611:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653618:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653652:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653892:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653902:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.653910:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920508.653926:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790920508.654076:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654086:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654094:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654101:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920508.654106:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654115:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654129:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920508.654132:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920508.654146:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654153:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654170:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654177:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654183:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654188:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920508.654192:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654198:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654206:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb0856f600) 00010000:00010000:0.0:1790920508.654208:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920508.654211:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654217:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654268:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad10 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654297:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad10 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.654316:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920508.654318:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920508.654321:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52c00, rc 0) 00000100:00100000:0.0:1790920508.654401:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:11468:x1877915951244416:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1045us (1352us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1790920508.654410:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 164 00000100:00100000:3.0:1790920508.660643:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.660774:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951244544 00000100:00100000:1.0:1790920508.660807:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951244544 00000100:00100000:1.0:1790920508.660934:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00100000:1.0:1790920508.660948:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:11468:x1877915951244544:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:1.0:1790920508.661046:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661071:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661086:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661120:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661128:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661136:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661144:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ce00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920508.661149:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661157:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661174:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920508.661177:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920508.661184:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.661202:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ac45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920508.661319:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:11468:x1877915951244544:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 374us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920508.661328:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00100000:2.0:1790920508.667048:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.667165:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951244672 00000100:00100000:0.0:1790920508.667180:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951244672 00000100:00100000:0.0:1790920508.667263:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920508.667275:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:2354:x1877915951244672:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920508.667309:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920508.667344:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad10 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.667465:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:0.0:1790920508.667472:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920508.667549:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:2354:x1877915951244672:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 275us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920508.667692:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:1.0:1790920508.670331:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.671262:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951244928 00000100:00100000:0.0:1790920508.671286:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951244928 00000100:00100000:0.0:1790920508.671582:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:0.0:1790920508.671617:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:11468:x1877915951244928:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1790920508.671967:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:11468:x1877915951244928:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 353us (1648us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1790920508.671976:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:1.0:1790920508.905410:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920508.905855:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951245184 00000100:00100000:3.0:1790920508.905869:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951245184 00000100:00100000:3.0:1790920508.905960:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:3.0:1790920508.905973:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:11486:x1877915951245184:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1790920508.906011:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920508.906047:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad17 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920508.906197:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546ac53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920508.906218:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546ac53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920508.906235:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546ac53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920508.906262:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790920508.906481:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad17 expref: 58 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920508.906506:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546ac53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad17 expref: 57 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920508.906516:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:3.0:1790920508.906520:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790920508.906523:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37400, rc 0) 00000100:00100000:3.0:1790920508.906613:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11486:x1877915951245184:12345-192.168.204.34@tcp:101:cat.0 Request processed in 643us (1220us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1790920508.906622:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:2.0:1790920508.954046:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920508.954172:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951245312 00000100:00100000:0.0:1790920508.954187:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951245312 00000100:00100000:0.0:1790920508.954270:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:0.0:1790920508.954283:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11487:x1877915951245312:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920508.954334:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920508.954374:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad1e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.954486:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.954506:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.954522:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920508.954568:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790920508.954573:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920508.954596:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.954628:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad1e expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.954677:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad1e expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920508.954693:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920508.954696:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920508.954700:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52600, rc 0) 00000100:00100000:0.0:1790920508.954862:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:11487:x1877915951245312:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 580us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920508.954870:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:2.0:1790920508.980417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.980592:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951245696 00000100:00100000:1.0:1790920508.980607:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951245696 00000100:00100000:1.0:1790920508.980689:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:1.0:1790920508.980700:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:11487:x1877915951245696:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920508.983157:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11487:x1877915951245696:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 1147us (1444us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1790920508.983186:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:3.0:1790920508.986422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920508.986627:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951245824 00000100:00100000:1.0:1790920508.986641:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951245824 00000100:00100000:1.0:1790920508.986738:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1790920508.986792:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11487:x1877915951245824:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:1.0:1790920508.986816:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790920508.986855:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546abf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad02 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.986884:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546ac53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad17 expref: 58 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.986925:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ab03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edacc3 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920508.986939:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486b00) 00010000:00010000:1.0:1790920508.986954:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920508.987034:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:11487:x1877915951245824:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 285us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920508.987046:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:2.0:1790920509.004356:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.004579:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951245952 00000100:00100000:3.0:1790920509.004594:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951245952 00000100:00100000:3.0:1790920509.004672:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:3.0:1790920509.004685:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:11487:x1877915951245952:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:3.0:1790920509.004884:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.005119:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.005136:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790920509.005420:0:11700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790920509.005581:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:11487:x1877915951245952:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 897us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.005611:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:3.0:1790920509.035796:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920509.044742:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951246080 00000100:00100000:0.0:1790920509.044787:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951246080 00000100:00100000:0.0:1790920509.044884:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:0.0:1790920509.044896:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:11489:x1877915951246080:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920509.044924:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920509.044953:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad25 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.045044:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.045061:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.045076:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.045093:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.045121:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.045129:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.047904:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.047933:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.047949:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920509.048013:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790920509.048019:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920509.048043:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048057:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048067:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048075:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048082:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048103:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920509.048109:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048118:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048134:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920509.048138:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920509.048144:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048150:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ac7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048164:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048170:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048176:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048181:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920509.048184:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048189:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048204:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb0856f600) 00010000:00010000:0.0:1790920509.048206:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920509.048210:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048215:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53600/0x2a4915844546ac84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048262:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546ac76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048276:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.048283:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:0.0:1790920509.048285:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920509.048287:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52200, rc 0) 00000100:00100000:0.0:1790920509.048410:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11489:x1877915951246080:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 3514us (12659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920509.048420:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 169 00000040:00080000:3.0:1790920509.099269:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790920509.099279:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790920509.099342:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790920509.099349:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790920509.099476:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d9e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972218880:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790920509.099595:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920509.102378:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d9e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972218880:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790920509.104513:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.104550:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951246208 00000100:00100000:2.0:1790920509.104560:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951246208 00000100:00100000:2.0:1790920509.104612:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:2.0:1790920509.104622:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11494:x1877915951246208:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790920509.104669:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790920509.104891:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11494:x1877915951246208:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 269us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920509.104899:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:3.0:1790920509.131084:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.131168:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951246336 00000100:00100000:2.0:1790920509.131178:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951246336 00000100:00100000:2.0:1790920509.131252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:2.0:1790920509.131262:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11494:x1877915951246336:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790920509.131451:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131484:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131497:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131569:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131578:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131585:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131612:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131620:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131627:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920509.131673:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790920509.131677:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920509.131690:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131700:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131718:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131725:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.131732:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.131737:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132014:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132027:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920509.132030:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920509.132036:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132042:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b200/0x2a4915844546ac92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132056:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132063:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132070:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132074:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.132083:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132089:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132096:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff88eb2cb2c600) 00010000:00010000:2.0:1790920509.132098:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920509.132101:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132107:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ac99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132125:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132131:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132137:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132141:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.132144:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132149:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132155:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:2.0:1790920509.132157:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920509.132164:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.132170:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.132345:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11494:x1877915951246336:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 1081us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920509.132354:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:1.0:1790920509.142519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.142788:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951246592 00000100:00100000:2.0:1790920509.142799:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951246592 00000100:00100000:2.0:1790920509.142863:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 172 00000100:00100000:2.0:1790920509.142872:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11494:x1877915951246592:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920509.142896:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920509.142917:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad2c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143025:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143039:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143051:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920509.143063:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790920509.143276:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143284:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143325:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143331:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.143335:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143343:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143356:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:2.0:1790920509.143359:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920509.143364:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143371:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143415:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad2c expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143425:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920509.143428:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790920509.143431:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546aca7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad2c expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.143440:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a000, rc 0) 00000100:00100000:2.0:1790920509.143511:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:11494:x1877915951246592:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 639us (999us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1790920509.143528:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 172 00000001:00080000:0.0:1790920509.144055:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:0.0:1790920509.144081:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:0.0:1790920509.144141:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790920509.144172:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88eb41e5e600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790920509.144178:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3faf0500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88eb41e5e000 00000020:00080000:0.0:1790920509.144181:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3faf0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb0b0a9800 00000020:00080000:3.0:1790920509.144288:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1790920509.144385:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920509.144405:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972219008:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1790920509.144470:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1790920509.144472:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920509.144519:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972219008 00000100:00100000:2.0:1790920509.144525:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972219008 00000100:00100000:2.0:1790920509.144582:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790920509.144591:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972219008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790920509.144612:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1790920509.144648:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abf473a, atime: 0x6abf473b, ctime: 0x6abf473a, blocks: 0xb 00000100:00080000:3.0:1790920509.144707:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790920509.145083:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.145101:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1790920509.145106:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920509.145112:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.145126:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.145136:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.145143:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.145185:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920509.145949:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920509.145958:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.145968:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920509.145972:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.145983:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.146002:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.146023:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546acbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.146045:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920509.146047:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920509.146049:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920509.146612:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972219008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2019us (2136us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790920509.146622:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790920509.146676:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1790920509.146683:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1790920509.146708:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88eb3af2c380 x1877915972219008/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790920525 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1790920509.146721:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb3af2c380/2, rc 0, transno 4294967307 00000100:00100000:1.0:1790920509.146727:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972219008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790920509.150971:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.151042:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951246720 00000100:00100000:3.0:1790920509.151053:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951246720 00000100:00100000:3.0:1790920509.151111:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 173 00000100:00100000:3.0:1790920509.151120:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11494:x1877915951246720:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790920509.151158:0:5847:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790920509.151287:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11494:x1877915951246720:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 166us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.151306:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 173 00000100:00100000:0.0:1790920509.160084:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.164141:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951246976 00000100:00100000:2.0:1790920509.164160:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951246976 00000100:00100000:2.0:1790920509.164236:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:2.0:1790920509.164247:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11494:x1877915951246976:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920509.164281:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920509.164285:0:11700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790920509.164326:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ac68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad1e expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.164349:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920509.164355:0:11700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920509.164369:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546acc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad33 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920509.166732:0:11700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1790920509.167598:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.167618:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.167631:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.168210:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546acc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad33 expref: 19 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.168237:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad33 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.168246:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920509.168249:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920509.168398:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b400, rc 0) 00000100:00100000:2.0:1790920509.168557:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11494:x1877915951246976:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 4310us (8744us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1790920509.168567:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:1.0:1790920509.176328:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.176465:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951247232 00000100:00100000:2.0:1790920509.176476:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951247232 00000100:00100000:2.0:1790920509.176600:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:2.0:1790920509.176611:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11494:x1877915951247232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790920509.176673:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920509.176704:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546acca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad33 expref: 18 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.176724:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920509.176739:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920509.176822:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.176837:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.176878:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.176894:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.176903:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.176910:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177155:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177163:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177169:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177175:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.177179:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177187:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177196:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920509.177199:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920509.177203:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177216:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56be00/0x2a4915844546acd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177225:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177231:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177236:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177240:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56bc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.177243:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177263:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177272:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3d77db82 (ffff88eb2cb2c700) 00010000:00010000:2.0:1790920509.177275:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920509.177278:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.177283:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546acdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3d77db82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.177373:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11494:x1877915951247232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 763us (1053us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790920509.177381:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:0.0:1790920509.191269:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.192037:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951247360 00000100:00100000:2.0:1790920509.192061:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951247360 00000100:00100000:3.0:1790920509.193979:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 176 00000100:00100000:3.0:1790920509.193995:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11494:x1877915951247360:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790920509.194018:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920509.194044:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ace6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad3a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.194081:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.194094:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.194126:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.194224:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ace6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.194243:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.194252:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:3.0:1790920509.194255:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790920509.194259:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36800, rc 0) 00000100:00100000:3.0:1790920509.194342:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11494:x1877915951247360:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 351us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.194350:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 176 00000100:00100000:0.0:1790920509.204449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.204485:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951247616 00000100:00100000:3.0:1790920509.204495:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951247616 00000100:00100000:3.0:1790920509.204557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 177 00000100:00100000:3.0:1790920509.204568:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11494:x1877915951247616:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790920509.204655:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.204671:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.204683:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790920509.205009:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1790920509.205021:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351371273010ns, next at 352371270617ns, rc = 0 00000004:00010000:3.0:1790920509.205105:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbf46b2f reply state 000000005e8781c4 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920509.205115:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790920509.205220:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11494:x1877915951247616:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 652us (778us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790920509.205227:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 177 00010000:00010000:3.0:1790920509.209406:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.209425:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.209433:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.209439:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920509.209445:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.209453:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.209471:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:3.0:1790920509.209474:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790920509.209480:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.209501:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546acf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920509.211263:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.211417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951247744 00000100:00100000:3.0:1790920509.211432:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951247744 00000100:00100000:3.0:1790920509.211501:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 178 00000100:00100000:3.0:1790920509.211512:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:11494:x1877915951247744:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790920509.211536:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920509.211578:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad41 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.211643:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.211658:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.211680:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:3.0:1790920509.211684:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790920509.211688:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36400, rc 0) 00000100:00100000:3.0:1790920509.211769:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11494:x1877915951247744:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 258us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.211776:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 178 00000100:00100000:1.0:1790920509.221673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.228474:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951247872 00000100:00100000:3.0:1790920509.228489:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951247872 00000100:00100000:3.0:1790920509.228579:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:3.0:1790920509.228589:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951247872:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790920509.229089:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951247872:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 499us (7424us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790920509.229099:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:1.0:1790920509.233894:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920509.234107:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951248128 00000100:00100000:0.0:1790920509.234121:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951248128 00000100:00100000:0.0:1790920509.234195:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:0.0:1790920509.234208:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11494:x1877915951248128:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790920509.234725:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:11494:x1877915951248128:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 517us (844us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790920509.234735:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:0.0:1790920509.239731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920509.239837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951248384 00000100:00100000:1.0:1790920509.239855:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951248384 00000100:00100000:1.0:1790920509.240102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 179 00000100:00100000:1.0:1790920509.240116:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:11494:x1877915951248384:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790920509.240261:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:11494:x1877915951248384:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 147us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920509.240277:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 179 00000100:00100000:3.0:1790920509.245736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920509.248358:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951248512 00000100:00100000:1.0:1790920509.248386:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951248512 00000100:00100000:1.0:1790920509.248463:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 180 00000100:00100000:1.0:1790920509.248474:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:11494:x1877915951248512:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920509.248495:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920509.248581:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad48 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.248657:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ad09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.248674:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ad09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.248687:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ad09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920509.248741:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920509.248792:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ad09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.248821:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad48 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.248840:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ad09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad48 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.248849:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:1.0:1790920509.248860:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790920509.248864:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443de00, rc 0) 00000100:00100000:1.0:1790920509.249058:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:11494:x1877915951248512:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 584us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920509.249065:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 180 00000100:00100000:2.0:1790920509.252853:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.253002:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951248640 00000100:00100000:3.0:1790920509.253013:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951248640 00000100:00100000:3.0:1790920509.253129:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:3.0:1790920509.253139:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951248640:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790920509.253157:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920509.253178:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad4f expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790920509.253206:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf473d, blocks: 0x1 00010000:00010000:3.0:1790920509.253226:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1790920509.253231:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920509.253240:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.253259:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.253272:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36a00, rc 0) 00000100:00100000:3.0:1790920509.253348:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951248640:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 210us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.253356:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:1.0:1790920509.259903:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.260425:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951248896 00000100:00100000:3.0:1790920509.260444:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951248896 00000100:00100000:3.0:1790920509.260509:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 181 00000100:00100000:3.0:1790920509.260520:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:11494:x1877915951248896:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790920509.260648:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:11494:x1877915951248896:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 129us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.260655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 181 00000100:00100000:1.0:1790920509.278934:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.279008:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951249024 00000100:00100000:2.0:1790920509.279021:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951249024 00000100:00100000:2.0:1790920509.279082:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1790920509.279092:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:11494:x1877915951249024:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920509.279112:0:8267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920509.279131:0:8267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad56 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.279161:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.279171:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920509.279176:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920509.279181:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.279218:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.279233:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 9 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.279262:0:8267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1877915972219136:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920509.279367:0:8267:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920509.283346:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.283401:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951249152 00000100:00100000:2.0:1790920509.283409:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951249152 00010000:00010000:2.0:1790920509.283453:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 10 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.283494:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:2.0:1790920509.283505:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2354:x1877915951249152:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920509.283532:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920509.283571:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 10 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.283588:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 10 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.283615:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920509.283619:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920509.283628:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.283639:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.283681:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 10 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.283695:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1877915972219264:192.168.204.34@tcp:105: 00000100:00100000:2.0:1790920509.283804:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f5a8d80 going to sleep for 11 seconds 00010000:00010000:1.0:1790920509.289064:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546ad10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad4f expref: 10 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920509.289089:0:8267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1877915972219136:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920509.289127:0:8267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 9 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.289145:0:8267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b400, rc 0) 00000100:00100000:1.0:1790920509.289213:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:11494:x1877915951249024:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 10122us (10287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920509.289223:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1790920509.289960:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1877915972219264:192.168.204.34@tcp:105: 00010000:00010000:2.0:1790920509.289977:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920509.290018:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951249152:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 6513us (6680us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920509.290028:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:1.0:1790920509.291769:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.291809:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951249280 00000100:00100000:2.0:1790920509.291818:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951249280 00002000:00100000:2.0:1790920509.291878:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88eb33f69880 x1877915951249280/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:120/0 lens 504/0 e 0 to 0 dl 1790920520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790920509.291889:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb33f69880 with x1877915951249280 ext(0->8) 00002000:00010000:2.0:1790920509.291894:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb33f69880 00000100:00100000:2.0:1790920509.291930:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:2.0:1790920509.291941:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951249280:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790920509.295155:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2354:x1877915951249280:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 3203us (3399us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790920509.295172:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00002000:00100000:2.0:1790920509.295188:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88eb33f69880 x1877915951249280/t4294967314(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:120/0 lens 504/448 e 0 to 0 dl 1790920520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790920509.295198:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb33f69880 with x1877915951249280 ext(0->8) 00002000:00010000:2.0:1790920509.295205:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb33f69880 00000100:00100000:1.0:1790920509.318595:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.318890:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951249408 00000100:00100000:3.0:1790920509.318911:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951249408 00000100:00100000:3.0:1790920509.318971:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 182 00000100:00100000:3.0:1790920509.318981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:11494:x1877915951249408:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790920509.406936:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1790920509.406969:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1790920509.406989:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1790920509.407252:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11494:x1877915951249408:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 88265us (88660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.407262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 182 00000020:00080000:3.0:1790920509.407301:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790920509.407959:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920509.407976:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972219392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790920509.408047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920509.408113:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972219392 00000100:00100000:0.0:1790920509.408120:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972219392 00000100:00100000:0.0:1790920509.408165:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790920509.408173:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972219392:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1790920509.408408:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00002000:00010000:0.0:1790920509.410951:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790920509.410961:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790920509 00002000:00010000:0.0:1790920509.410964:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790920509.410966:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790920509 -> 1790920509 00002000:00010000:0.0:1790920509.410968:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790920509.411070:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972219392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2894us (3018us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790920509.411081:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1790920509.411116:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920509.411482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.412891:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951249536 00000100:00100000:3.0:1790920509.412916:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951249536 00000100:00100000:3.0:1790920509.412987:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:3.0:1790920509.412998:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2355:x1877915951249536:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1790920509.413989:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb0562b800/2, rc 0, transno 4294967315 00000100:00100000:2.0:1790920509.414012:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972219392:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1790920509.483672:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920509.490940:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2355:x1877915951249536:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 77933us (79449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920509.490955:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000001:00080000:1.0:1790920509.490999:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1790920509.491020:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1790920509.500191:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.502810:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951249792 00000100:00100000:3.0:1790920509.502830:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951249792 00000100:00100000:3.0:1790920509.503080:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 183 00000100:00100000:3.0:1790920509.503093:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11494:x1877915951249792:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790920509.503149:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920509.503187:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443de00/0x2a4915844546ad09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad48 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.503205:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:3.0:1790920509.503210:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920509.503243:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.503256:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.503266:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920509.503537:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000184b4bd9 reply state 0000000030d8dc38 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920509.503548:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790920509.506393:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:11494:x1877915951249792:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 3292us (6199us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1790920509.506406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 183 00000100:00100000:0.0:1790920509.517159:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920509.517350:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951249920 00000100:00100000:3.0:1790920509.517361:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951249920 00000100:00100000:3.0:1790920509.517423:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:3.0:1790920509.517433:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951249920:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790920509.517722:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790920509.517726:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790920509 -> 1790920508 00002000:00010000:3.0:1790920509.517729:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790920507 00002000:00010000:3.0:1790920509.517732:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790920509 -> 1790920508 00002000:00010000:3.0:1790920509.517743:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790920509.517838:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951249920:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 405us (692us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790920509.517845:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00010000:00010000:1.0:1790920509.520161:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.520185:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.520193:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.520200:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920509.520206:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.520214:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.520233:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:1.0:1790920509.520236:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920509.520241:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.520247:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546ad1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920509.533164:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.533673:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951250176 00000100:00100000:2.0:1790920509.533684:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951250176 00000100:00100000:2.0:1790920509.533766:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 184 00000100:00100000:2.0:1790920509.533777:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11494:x1877915951250176:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790920509.533850:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.533867:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.533875:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.533908:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.533921:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 18 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.533935:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972219520:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920509.534018:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920509.541105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920509.541214:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951250304 00000100:00100000:1.0:1790920509.541229:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951250304 00000100:00100000:0.0:1790920509.541240:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972219520:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920509.541274:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.541303:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920509.541370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:1.0:1790920509.541384:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:2354:x1877915951250304:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920509.541423:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920509.541434:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.541452:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.541497:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546aced lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad3a expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.541517:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:1.0:1790920509.541523:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.541535:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.541556:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.541605:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920509.541694:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:2354:x1877915951250304:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 312us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920509.541703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00010000:00010000:2.0:1790920509.542515:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542540:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542583:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542610:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542617:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542623:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ba00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.542627:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542636:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542652:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:2.0:1790920509.542655:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790920509.542659:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.542665:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.543048:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11494:x1877915951250176:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 9267us (9886us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790920509.543059:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 184 00000100:00100000:0.0:1790920509.548293:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972219648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920509.548376:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920509.550389:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972219648 00000100:00100000:1.0:1790920509.550413:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972219648 00000100:00100000:1.0:1790920509.550514:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790920509.550530:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972219648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920509.550583:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920509.550733:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972219648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920509.550742:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790920509.550830:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972219648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920509.557490:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.557621:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951250432 00000100:00100000:2.0:1790920509.557636:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951250432 00000100:00100000:2.0:1790920509.557706:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:2.0:1790920509.557716:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2353:x1877915951250432:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790920509.557792:0:8267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.557821:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 8 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.557829:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920509.557834:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920509.557839:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.557877:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 8 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.557891:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 8 pid: 8267 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.559042:0:8267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1877915972219776:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920509.559149:0:8267:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb058f1480 going to sleep for 11 seconds 00000100:00100000:0.0:1790920509.565974:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.566846:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951250560 00000100:00100000:2.0:1790920509.566858:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951250560 00010000:00010000:2.0:1790920509.566907:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 9 pid: 8267 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.566948:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:2.0:1790920509.566958:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951250560:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920509.566973:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920509.566996:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 9 pid: 8267 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567030:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 9 pid: 8267 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567056:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920509.567061:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920509.567067:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567077:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567099:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920509.567170:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951250560:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 213us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920509.567177:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00010000:00010000:2.0:1790920509.567262:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba62ac9/0x2a4915844546ad17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad56 expref: 8 pid: 8267 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.567276:0:8267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8267:1877915972219776:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920509.567306:0:8267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567316:0:8267:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567333:0:8267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567359:0:8267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567367:0:8267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567376:0:8267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567383:0:8267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ba00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920509.567387:0:8267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567395:0:8267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567406:0:8267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.567413:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008df61d27/0x2a4915844546ad2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.567468:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2353:x1877915951250432:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 9754us (9993us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920509.567477:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:3.0:1790920509.578502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920509.578990:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951250816 00000100:00100000:0.0:1790920509.579001:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951250816 00000100:00100000:0.0:1790920509.579068:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 185 00000100:00100000:0.0:1790920509.579079:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+17:11494:x1877915951250816:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790920509.579170:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.579189:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.579200:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.579645:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.579659:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.579682:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.580100:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920509.580117:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 18 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920509.580135:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972219904:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920509.580214:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790920509.583273:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.583426:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951250944 00000100:00100000:2.0:1790920509.583435:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951250944 00000100:00100000:1.0:1790920509.583534:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972219904:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920509.583553:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.583576:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.583674:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:2.0:1790920509.583687:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:2354:x1877915951250944:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920509.583704:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920509.583713:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.583731:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.583806:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546acfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad41 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.583822:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:2.0:1790920509.583828:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.583839:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.583863:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.583892:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920509.583943:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:2354:x1877915951250944:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 259us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920509.583952:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 70 00010000:00010000:1.0:1790920509.583967:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.583978:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920509.584294:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1790920509.585157:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1790920509.585245:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1790920509.585341:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972220032:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790920509.585410:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920509.585450:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920509.585490:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972220032 00000100:00100000:1.0:1790920509.585505:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972220032 00000100:00100000:1.0:1790920509.585633:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790920509.585646:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877915972220032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790920509.585849:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1877915972220032:12345-0@lo:1000:mdt00_001.0 Request processed in 205us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920509.585858:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790920509.586525:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790920509.586534:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb0562b800, transno 4294967315 00000100:00100000:2.0:1790920509.586554:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972220032:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790920509.587438:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1790920509.587554:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972220160:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790920509.587627:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920509.587665:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88ea03784b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790920509.587695:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972220160 00000100:00100000:0.0:1790920509.587709:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972220160 00000100:00100000:0.0:1790920509.587919:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790920509.587934:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1877915972220160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790920509.588237:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1877915972220160:12345-0@lo:1000:mdt00_001.0 Request processed in 307us (609us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790920509.588246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790920509.589848:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1877915972220160:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790920509.589908:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.589922:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.589931:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.589939:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.589946:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.589974:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.589994:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb04d19200) 00010000:00010000:2.0:1790920509.589998:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920509.590005:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590012:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546ad3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590047:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590054:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590060:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590065:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920509.590067:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590080:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590090:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:2.0:1790920509.590093:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920509.590096:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590114:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36e00/0x2a4915844546ac6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590147:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590163:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590172:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590212:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920509.590233:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 21 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920509.590248:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972220288:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920509.590372:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88ea03784b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920509.596011:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920509.596057:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972220288:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920509.596097:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920509.596100:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951251072 00000100:00100000:3.0:1790920509.596111:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951251072 00010000:00010000:3.0:1790920509.596151:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 22 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920509.596247:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:3.0:1790920509.596258:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:2355:x1877915951251072:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920509.596272:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920509.596290:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 22 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.596308:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 22 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.596333:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546ac8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad25 expref: 22 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.596349:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:3.0:1790920509.596354:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.596364:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.596387:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.596411:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920509.596492:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:2355:x1877915951251072:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 236us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920509.596500:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 71 00010000:00010000:1.0:1790920509.596576:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596589:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596606:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596627:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596636:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596643:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ba00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920509.596649:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596658:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596673:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:1.0:1790920509.596677:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920509.596682:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596688:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ad41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596705:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596711:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596717:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.596722:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920509.596733:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.597612:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.597636:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:1.0:1790920509.597640:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790920509.597646:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.597653:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546ad33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920509.598073:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11494:x1877915951250816:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 18987us (19570us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1790920509.598086:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 185 00000020:00080000:1.0:1790920509.598094:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790920509.598727:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790920509.598735:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920509.599273:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1790920509.599297:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790920509.615952:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920509.616008:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951251328 00000100:00100000:1.0:1790920509.616019:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951251328 00000100:00100000:1.0:1790920509.616093:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:1.0:1790920509.616104:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11494:x1877915951251328:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790920509.617142:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790920509.617310:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1790920509.617377:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.617401:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.617433:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.617496:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.617505:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.617511:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920509.617542:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790920509.617654:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:11494:x1877915951251328:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 1549us (1715us total) trans 4294967469 rc 0/0 00010000:00010000:3.0:1790920509.617733:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920509.617757:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.617766:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443ce00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920509.617771:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.617780:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.617794:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88eb01486000) 00010000:00010000:3.0:1790920509.617797:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790920509.617802:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.617808:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443ce00/0x2a4915844546ad48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920509.617829:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920509.617831:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920509.617832:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920509.618258:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00000020:00080000:1.0:1790920509.618388:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1790920509.995060:0:12423:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790920509.995072:0:12423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920509.995111:0:12423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790920509.995118:0:12423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790920510.165353:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.165719:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951251584 00000100:00100000:2.0:1790920510.165731:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951251584 00000100:00100000:2.0:1790920510.165836:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 186 00000100:00100000:2.0:1790920510.165847:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:11510:x1877915951251584:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920510.165881:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920510.165907:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ad4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad5d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.166026:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546ad56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.166041:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546ad56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.166056:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546ad56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920510.166068:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790920510.166191:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ad4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad5d expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.166207:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546ad56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad5d expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.166216:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920510.166219:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790920510.166222:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a600, rc 0) 00000100:00100000:2.0:1790920510.166291:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:11510:x1877915951251584:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 446us (950us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1790920510.166298:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 186 00000100:00080000:1.0:1790920510.166602:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920510.169069:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920510.169465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951251712 00000100:00100000:0.0:1790920510.169476:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951251712 00000100:00100000:0.0:1790920510.169541:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 187 00000100:00100000:0.0:1790920510.169551:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:11510:x1877915951251712:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:3.0:1790920510.170006:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170027:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170038:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170054:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170060:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170067:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170309:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170319:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170327:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920510.170369:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170382:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170388:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170403:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170409:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.170413:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170421:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170433:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920510.170437:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.170441:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170459:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546ad64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170472:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170479:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170486:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170491:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.170495:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170676:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170686:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb04d19d00) 00010000:00010000:3.0:1790920510.170688:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.170692:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170697:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546ad6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170711:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170717:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170723:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170729:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.170732:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170738:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170845:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb04d19600) 00010000:00010000:3.0:1790920510.170849:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.170852:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.170869:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ad72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920510.170958:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:11510:x1877915951251712:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 1406us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920510.170967:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 187 00000100:00100000:1.0:1790920510.242564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.242653:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951251968 00000100:00100000:2.0:1790920510.242665:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951251968 00000100:00100000:2.0:1790920510.242769:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 188 00000100:00100000:2.0:1790920510.242791:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+24:11513:x1877915951251968:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920510.242816:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920510.242841:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ad79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad64 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.242922:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.242938:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.242950:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.242965:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.242972:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.242978:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243251:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243260:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243279:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920510.243302:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790920510.243397:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243404:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243411:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243418:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920510.243422:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243430:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243443:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920510.243446:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920510.243451:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243458:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ad80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243470:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243477:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243493:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243499:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ae00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920510.243502:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243510:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243519:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920510.243522:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920510.243525:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243531:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546ad87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243582:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ad79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243598:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.243605:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:2.0:1790920510.243607:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920510.243610:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a400, rc 0) 00000100:00100000:2.0:1790920510.243674:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11513:x1877915951251968:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 885us (1117us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1790920510.243691:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 188 00000100:00100000:0.0:1790920510.258919:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920510.259028:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951252096 00000100:00100000:1.0:1790920510.259042:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951252096 00000100:00100000:1.0:1790920510.259105:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 189 00000100:00100000:1.0:1790920510.259117:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11513:x1877915951252096:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:1.0:1790920510.259197:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259217:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259250:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259291:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259298:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259305:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259311:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920510.259315:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259323:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259337:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:1.0:1790920510.259340:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920510.259345:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.259352:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546ad9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920510.259441:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11513:x1877915951252096:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 326us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920510.259449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 189 00000100:00100000:1.0:1790920510.261140:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.261251:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951252352 00000100:00100000:2.0:1790920510.261261:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951252352 00000100:00100000:2.0:1790920510.261330:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:2.0:1790920510.261340:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11513:x1877915951252352:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1790920510.262342:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:11513:x1877915951252352:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 996us (1202us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1790920510.262354:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:2.0:1790920510.316311:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920510.316470:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951252608 00000100:00100000:3.0:1790920510.316481:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951252608 00000100:00100000:3.0:1790920510.316741:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 190 00000100:00100000:3.0:1790920510.316792:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:11048:x1877915951252608:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1790920510.316817:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920510.316839:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ada3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad6b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.316955:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.316972:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.316981:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.317018:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.317032:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 28 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920510.317065:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41d9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972220416:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920510.317167:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920510.322472:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920510.324384:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951252736 00000100:00100000:1.0:1790920510.324400:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951252736 00010000:00010000:1.0:1790920510.324465:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 29 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920510.324527:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:1.0:1790920510.324538:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:2354:x1877915951252736:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920510.324556:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920510.324575:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 29 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.324589:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 29 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.324612:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:1.0:1790920510.324618:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.324629:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.324636:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.324655:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920510.324733:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:2354:x1877915951252736:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 196us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920510.324742:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00010000:00010000:2.0:1790920510.326010:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ad8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad64 expref: 28 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920510.326034:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41d9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1877915972220416:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920510.326057:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.326066:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.326073:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920510.326094:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790920510.326263:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546ada3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.326993:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.327023:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:2.0:1790920510.327026:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790920510.327029:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36400, rc 0) 00000100:00100000:2.0:1790920510.327106:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:11048:x1877915951252608:12345-192.168.204.34@tcp:101:bash.0 Request processed in 10315us (10812us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1790920510.327114:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 190 00000100:00100000:3.0:1790920510.334113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920510.334445:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951252992 00000100:00100000:1.0:1790920510.334485:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951252992 00000100:00100000:1.0:1790920510.334561:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 191 00000100:00100000:1.0:1790920510.334579:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:11048:x1877915951252992:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:1.0:1790920510.335277:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.335432:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.335447:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920510.335529:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1790920510.335560:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3c8ce0c reply state 000000004f94807c transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920510.335954:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790920510.336020:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1790920510.336201:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:11048:x1877915951252992:12345-192.168.204.34@tcp:36:bash.0 Request processed in 1621us (2097us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1790920510.336209:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 191 00000020:00080000:1.0:1790920510.336214:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1790920510.349013:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.349036:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.349045:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.349052:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.349058:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.349066:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.349083:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:3.0:1790920510.349086:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.349092:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.349098:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546adb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920510.350816:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920510.351042:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951253120 00000100:00100000:1.0:1790920510.351054:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951253120 00000100:00100000:1.0:1790920510.351156:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 192 00000100:00100000:1.0:1790920510.351166:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:11048:x1877915951253120:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920510.351191:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920510.351213:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546adbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad72 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.351326:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546adbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad72 expref: 32 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.351341:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546adbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad72 expref: 32 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.351360:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:1.0:1790920510.351363:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790920510.351366:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d400, rc 0) 00000100:00100000:1.0:1790920510.351429:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:11048:x1877915951253120:12345-192.168.204.34@tcp:101:bash.0 Request processed in 264us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920510.351436:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 192 00000100:00100000:3.0:1790920510.355046:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920510.355168:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951253248 00000100:00100000:0.0:1790920510.355178:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951253248 00000100:00100000:0.0:1790920510.355259:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:0.0:1790920510.355283:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:11048:x1877915951253248:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920510.355308:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920510.355332:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad79 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790920510.355361:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abf473c, atime: 0x6abf473b, ctime: 0x6abf473c, blocks: 0xb 00010000:00010000:0.0:1790920510.355384:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1790920510.355389:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920510.355397:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.355416:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.355443:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52000, rc 0) 00000100:00100000:0.0:1790920510.355501:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:11048:x1877915951253248:12345-192.168.204.34@tcp:101:bash.0 Request processed in 232us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920510.355521:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00080000:2.0:1790920510.355963:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920510.358807:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920510.358907:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951253376 00000100:00100000:0.0:1790920510.358919:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951253376 00002000:00010000:0.0:1790920510.358968:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1790920510.358974:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb41d9d880 with x1877915951253376 ext(0->18446744073709551615) 00002000:00010000:0.0:1790920510.358987:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb41d9d880. 00000100:00100000:0.0:1790920510.359025:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:0.0:1790920510.359036:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951253376:12345-192.168.204.34@tcp:10:bash.0 00002000:00010000:0.0:1790920510.359481:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790920510.359485:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790920508 -> 1790920510 00002000:00010000:0.0:1790920510.359488:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790920507 -> 1790920507 00002000:00010000:0.0:1790920510.359491:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790920508 -> 1790920510 00002000:00010000:0.0:1790920510.359493:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790920510.360238:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951253376:12345-192.168.204.34@tcp:10:bash.0 Request processed in 1199us (1438us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790920510.360248:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00002000:00010000:0.0:1790920510.360253:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1790920510.360257:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb41d9d880 with x1877915951253376 ext(0->18446744073709551615) 00002000:00010000:0.0:1790920510.360278:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb41d9d880. 00000100:00100000:1.0:1790920510.498575:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920510.498703:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951253504 00000100:00100000:3.0:1790920510.498715:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951253504 00000100:00100000:3.0:1790920510.498799:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 193 00000100:00100000:3.0:1790920510.498809:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:11527:x1877915951253504:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:3.0:1790920510.498891:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.498909:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.498920:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.498936:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.498943:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.498950:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499192:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499201:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499208:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790920510.499282:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499293:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499300:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499307:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499313:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.499317:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499325:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499336:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920510.499339:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.499344:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499350:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546adcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499363:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499368:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499382:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499387:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.499391:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499397:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499405:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb04d19600) 00010000:00010000:3.0:1790920510.499407:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.499410:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499416:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546add4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499432:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499439:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499445:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499457:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.499460:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499477:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499486:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:3.0:1790920510.499489:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.499492:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.499498:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546addb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920510.499573:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:11527:x1877915951253504:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 765us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920510.499581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 193 00010000:00010000:1.0:1790920510.504986:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920510.590516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.591087:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951253760 00000100:00100000:2.0:1790920510.591098:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951253760 00000100:00100000:2.0:1790920510.591175:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 194 00000100:00100000:2.0:1790920510.591186:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+32:11530:x1877915951253760:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920510.591210:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920510.591237:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ade2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad80 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.591332:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.591348:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.591361:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.591377:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.591407:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.591415:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592083:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546adf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592098:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546adf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592105:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546adf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920510.592116:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790920510.592222:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592230:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592237:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592243:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920510.592249:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592257:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592293:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920510.592296:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920510.592302:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592309:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ade9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592325:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592331:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592338:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592344:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920510.592347:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592353:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592361:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb2cb2c700) 00010000:00010000:2.0:1790920510.592363:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920510.592366:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592371:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546adf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592431:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a200/0x2a4915844546ade2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad80 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592447:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546adf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad80 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.592455:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:2.0:1790920510.592457:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790920510.592460:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ae00, rc 0) 00000100:00100000:2.0:1790920510.592550:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11530:x1877915951253760:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1366us (2053us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790920510.593242:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 194 00000100:00100000:2.0:1790920510.598242:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920510.598365:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951253888 00000100:00100000:3.0:1790920510.598377:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951253888 00000100:00100000:3.0:1790920510.598443:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:3.0:1790920510.598454:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11530:x1877915951253888:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:3.0:1790920510.598536:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.598554:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.598566:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.598608:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.598638:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 34 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920510.598655:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972220544:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920510.598810:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920510.603193:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972220544:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920510.603227:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920510.607883:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920510.608469:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951254144 00000100:00100000:1.0:1790920510.608489:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951254144 00000100:00100000:1.0:1790920510.609911:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:1.0:1790920510.609939:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:5593:x1877915951254144:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790920510.611028:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:5593:x1877915951254144:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 1097us (3279us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790920510.611044:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:0.0:1790920510.615300:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.615965:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951254272 00000100:00100000:2.0:1790920510.615980:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951254272 00010000:00010000:2.0:1790920510.616035:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 36 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920510.616085:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:2.0:1790920510.616096:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:2355:x1877915951254272:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920510.616115:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920510.616123:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 36 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.616138:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 36 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.616184:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546adaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad6b expref: 36 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.616204:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:2.0:1790920510.616210:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.616220:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.616228:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.616282:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920510.616354:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:2355:x1877915951254272:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 259us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920510.616361:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00010000:00010000:0.0:1790920510.616442:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616471:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616512:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616520:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616528:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616534:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920510.616538:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616546:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616556:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:0.0:1790920510.616567:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920510.616572:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.616578:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546ae05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920510.616621:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11530:x1877915951253888:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 18169us (18390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920510.616629:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:3.0:1790920510.620721:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920510.621070:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951254528 00000100:00100000:1.0:1790920510.621085:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951254528 00000100:00100000:1.0:1790920510.621226:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:1.0:1790920510.621240:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+34:11530:x1877915951254528:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920510.621669:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:11530:x1877915951254528:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 431us (964us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790920510.621679:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:1.0:1790920510.754664:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.756038:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951254784 00000100:00100000:2.0:1790920510.756057:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951254784 00000100:00100000:2.0:1790920510.756155:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 196 00000100:00100000:2.0:1790920510.756167:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+35:11542:x1877915951254784:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:2.0:1790920510.756204:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920510.756233:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ae0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad87 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.756352:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.756395:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.756411:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.756430:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.756437:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.756443:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757542:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ae21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757565:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757577:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920510.757592:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1790920510.757730:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757738:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757767:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757784:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920510.757789:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757798:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757813:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920510.757817:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920510.757822:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757828:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757845:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757851:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757857:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757862:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920510.757864:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757884:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757904:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb2cb2c700) 00010000:00010000:2.0:1790920510.757907:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920510.757910:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757916:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.757988:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546ae0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad87 expref: 38 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.758004:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ae21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad87 expref: 37 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.758011:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:2.0:1790920510.758014:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920510.758016:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ba00, rc 0) 00000100:00100000:2.0:1790920510.758128:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:11542:x1877915951254784:12345-192.168.204.34@tcp:101:cat.0 Request processed in 1961us (3478us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1790920510.758138:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 196 00000100:00100000:0.0:1790920510.771317:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.773974:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951255040 00000100:00100000:2.0:1790920510.773991:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951255040 00000100:00100000:3.0:1790920510.774212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:3.0:1790920510.774224:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:11542:x1877915951255040:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:3.0:1790920510.774499:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:11542:x1877915951255040:12345-192.168.204.34@tcp:35:cat.0 Request processed in 276us (3192us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1790920510.774507:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:3.0:1790920510.815522:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920510.815622:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951255296 00000100:00100000:1.0:1790920510.815632:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951255296 00000100:00100000:1.0:1790920510.815694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 197 00000100:00100000:1.0:1790920510.815704:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:11543:x1877915951255296:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:1.0:1790920510.815800:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790920510.815828:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546ae21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad87 expref: 38 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.815854:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546adf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad80 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.815867:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546adbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad72 expref: 36 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.816489:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb2cb2ce00) 00010000:00010000:1.0:1790920510.816509:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920510.816533:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.816549:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.816560:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.816597:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.816605:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.816612:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.818334:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.818353:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.818364:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790920510.819855:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1790920510.819935:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352986120167ns, next at 353986117820ns, rc = 0 00010000:00010000:1.0:1790920510.820032:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820047:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820057:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820066:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820085:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820090:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820192:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790920510.820226:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820233:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820241:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820248:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443da00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920510.820253:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820271:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820290:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486800) 00010000:00010000:1.0:1790920510.820294:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790920510.820299:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820306:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546ae3d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820326:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820339:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820346:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820351:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920510.820355:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820361:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820370:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:1.0:1790920510.820372:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920510.820376:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.820382:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790920510.820394:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000703b1de8 reply state 00000000244c97eb transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920510.820403:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790920510.820507:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+37:11543:x1877915951255296:12345-192.168.204.34@tcp:36:rm.0 Request processed in 4800us (4992us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1790920510.820517:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 197 00010000:00010000:1.0:1790920510.824935:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.824986:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.824995:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.825002:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443dc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920510.825007:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.825015:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.825034:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb01486b00) 00010000:00010000:1.0:1790920510.825038:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920510.825043:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.825049:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.826039:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920510.826052:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.826061:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920510.826065:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.826072:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.826097:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88eb01486800) 00010000:00010000:3.0:1790920510.826100:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790920510.826103:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.826108:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546ae44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.826130:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920510.826132:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920510.826134:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920510.897899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920510.898122:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951255552 00000100:00100000:2.0:1790920510.898133:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951255552 00000100:00100000:2.0:1790920510.898194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 198 00000100:00100000:2.0:1790920510.898204:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+36:11549:x1877915951255552:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1790920510.898227:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920510.898266:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad8e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.898386:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.898402:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.898415:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.898430:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.898438:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.898445:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920510.899533:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1790920510.901383:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901405:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901417:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901582:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901606:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901613:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901619:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920510.901624:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901632:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901865:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920510.901931:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920510.901937:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.901944:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546ae52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920510.901963:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000003bd2fe reply state 000000002c80fd25 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920510.901973:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790920510.902013:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546ae4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.902029:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920510.902051:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920510.902053:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920510.902056:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a000, rc 0) 00000100:00100000:2.0:1790920510.902213:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:11549:x1877915951255552:12345-192.168.204.34@tcp:101:bash.0 Request processed in 4009us (4323us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790920510.902222:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 198 00000100:00100000:2.0:1790920510.910977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:3.0:1790920510.911624:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.911638:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.911646:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.911662:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920510.911667:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.911675:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.911691:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb2cb2c700) 00010000:00010000:3.0:1790920510.911693:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920510.911712:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.911719:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546ae59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920510.912227:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951255680 00000100:00100000:1.0:1790920510.912239:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951255680 00000100:00100000:1.0:1790920510.912647:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:1.0:1790920510.912659:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2355:x1877915951255680:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920510.912676:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920510.912696:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad95 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790920510.912740:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790920510.912798:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1790920510.912803:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920510.912813:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.912831:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.912844:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443dc00, rc 0) 00000100:00100000:1.0:1790920510.913245:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951255680:12345-192.168.204.34@tcp:101:bash.0 Request processed in 587us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920510.913253:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00080000:2.0:1790920510.913532:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790920510.919862:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920510.921670:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951255808 00000100:00100000:0.0:1790920510.921686:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951255808 00000100:00100000:0.0:1790920510.923176:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:0.0:1790920510.923192:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:11549:x1877915951255808:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920510.923214:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920510.923236:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edad9c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.923285:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.923296:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920510.923301:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920510.923307:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.923619:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920510.923634:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 7 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920510.923664:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877915972220672:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920510.923809:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681600 going to sleep for 11 seconds 00000100:00100000:0.0:1790920510.927477:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920510.927605:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877915972220672:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920510.927642:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920510.927665:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53c00, rc 0) 00000100:00100000:3.0:1790920510.927737:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:11549:x1877915951255808:12345-192.168.204.34@tcp:101:bash.0 Request processed in 4549us (9726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920510.927767:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:1.0:1790920510.927862:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951255936 00000100:00100000:1.0:1790920510.927871:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951255936 00010000:00010000:1.0:1790920510.927909:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 7 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920510.927947:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:1.0:1790920510.927972:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951255936:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920510.927988:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920510.928012:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 7 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.928040:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 7 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.928067:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546ae6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad95 expref: 7 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.928082:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920510.928087:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920510.928096:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.928107:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920510.928143:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920510.928159:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1877915972220800:192.168.204.34@tcp:105: 00000100:00100000:1.0:1790920510.928226:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696240 going to sleep for 11 seconds 00000100:00100000:1.0:1790920510.938879:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a28700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1877915972220800:192.168.204.34@tcp:105: 00010000:00010000:1.0:1790920510.938912:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920510.938978:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2354:x1877915951255936:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 11008us (11511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920510.938990:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:2.0:1790920510.941079:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920510.941191:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951256192 00000100:00100000:3.0:1790920510.941201:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951256192 00000100:00100000:3.0:1790920510.941272:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:3.0:1790920510.941283:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+38:11549:x1877915951256192:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:3.0:1790920510.941633:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:11549:x1877915951256192:12345-192.168.204.34@tcp:35:bash.0 Request processed in 350us (561us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1790920510.941651:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:2.0:1790920511.139271:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920511.139387:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951256320 00000100:00100000:0.0:1790920511.139399:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951256320 00000100:00100000:0.0:1790920511.139463:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 199 00000100:00100000:0.0:1790920511.139474:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+39:11564:x1877915951256320:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920511.139502:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920511.139526:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546ae7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edada3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.139598:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546ae83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.139614:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.139626:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920511.139660:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790920511.139664:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920511.139682:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.139707:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546ae7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edada3 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.139725:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546ae83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edada3 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.139734:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920511.139737:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920511.139802:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53e00, rc 0) 00000100:00100000:0.0:1790920511.139875:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:11564:x1877915951256320:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 392us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920511.139882:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 199 00000100:00100000:0.0:1790920511.144162:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920511.144242:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951256576 00000100:00100000:1.0:1790920511.144265:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951256576 00000100:00100000:1.0:1790920511.144326:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 200 00000100:00100000:1.0:1790920511.144336:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+40:11564:x1877915951256576:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920511.144358:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920511.144381:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadaa expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.144511:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.144527:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.144539:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920511.144552:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790920511.144698:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546ae8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadaa expref: 43 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.144718:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadaa expref: 42 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.144726:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:1.0:1790920511.144728:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790920511.144732:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c000, rc 0) 00000100:00100000:1.0:1790920511.144899:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+42:11564:x1877915951256576:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 564us (747us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790920511.144917:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 200 00000100:00100000:2.0:1790920511.155382:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920511.155439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920511.155549:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951256832 00000100:00100000:0.0:1790920511.155565:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951256832 00000100:00100000:0.0:1790920511.155634:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:0.0:1790920511.155647:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+42:11564:x1877915951256832:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920511.155681:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920511.155708:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546ae9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadb1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.156087:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546aea6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.156107:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546aea6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.156121:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546aea6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920511.156137:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790920511.156324:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546ae9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadb1 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.156348:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546aea6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadb1 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.156358:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:0.0:1790920511.156380:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790920511.156385:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53a00, rc 0) 00000100:00100000:0.0:1790920511.156462:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+44:11564:x1877915951256832:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 818us (1095us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1790920511.156471:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:3.0:1790920511.157074:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951256960 00000100:00100000:3.0:1790920511.157084:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951256960 00000100:00100000:3.0:1790920511.157149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:3.0:1790920511.157158:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+44:2354:x1877915951256960:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920511.157172:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920511.157194:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c000/0x2a4915844546ae91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadaa expref: 44 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.157222:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:3.0:1790920511.157227:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920511.157283:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:2354:x1877915951256960:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 126us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920511.157290:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:2.0:1790920511.164654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.164989:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951257088 00000100:00100000:3.0:1790920511.165003:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951257088 00000100:00100000:3.0:1790920511.165070:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:3.0:1790920511.165084:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+6:2355:x1877915951257088:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:3.0:1790920511.165146:0:8267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.165172:0:8267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.165183:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920511.165189:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920511.165194:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.165241:0:8267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.165267:0:8267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 6 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920511.165311:0:8267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1877915972220928:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920511.165427:0:8267:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920511.169407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920511.169510:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951257216 00000100:00100000:2.0:1790920511.169523:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951257216 00002000:00100000:2.0:1790920511.169598:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88eb33f72680 x1877915951257216/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:122/0 lens 504/0 e 0 to 0 dl 1790920522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790920511.169613:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb33f72680 with x1877915951257216 ext(0->8) 00010000:00010000:2.0:1790920511.169626:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 7 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.169650:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 7 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790920511.169687:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb33f72680 00000100:00100000:2.0:1790920511.169729:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:2.0:1790920511.169741:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951257216:12345-192.168.204.34@tcp:4:lfs.0 00000100:00100000:2.0:1790920511.170475:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951257216:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 729us (1080us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790920511.170486:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00002000:00100000:2.0:1790920511.170497:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88eb33f72680 x1877915951257216/t4294967308(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:122/0 lens 504/448 e 0 to 0 dl 1790920522 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790920511.170506:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb33f72680 with x1877915951257216 ext(0->8) 00010000:00010000:2.0:1790920511.170515:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 9 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.170533:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 9 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790920511.170542:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88eb33f72680 00000100:00100000:3.0:1790920511.170854:0:8267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8267:1877915972220928:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920511.170894:0:8267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920511.177503:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920511.177616:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951257344 00000100:00100000:2.0:1790920511.177630:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951257344 00010000:00010000:2.0:1790920511.177686:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 9 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920511.177906:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:2.0:1790920511.177919:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2353:x1877915951257344:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920511.177963:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790920511.177988:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790920511.177992:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790920511 00002000:00010000:2.0:1790920511.177995:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790920511 00002000:00010000:2.0:1790920511.177997:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790920511 00010000:00010000:2.0:1790920511.178005:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 9 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.178022:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 9 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.178054:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000978cdd1e/0x2a4915844546ae75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad9c expref: 9 pid: 6689 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.178077:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920511.178082:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920511.178090:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.178101:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.178142:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920511.178213:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2353:x1877915951257344:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 295us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920511.178222:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 75 00010000:00010000:3.0:1790920511.178371:0:8267:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178382:0:8267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178413:0:8267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178423:0:8267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178432:0:8267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178440:0:8267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920511.178445:0:8267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178469:0:8267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178484:0:8267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.178491:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546aeb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920511.178552:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951257088:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 13471us (13914us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920511.178562:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:0.0:1790920511.184166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.185310:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951257600 00000100:00100000:3.0:1790920511.185328:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951257600 00000100:00100000:3.0:1790920511.185405:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:3.0:1790920511.185418:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+43:11564:x1877915951257600:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:3.0:1790920511.185517:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546aea6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadb1 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790920511.185907:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1790920511.185958:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1790920511.186409:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1790920511.186494:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.186519:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.186550:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.186602:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.186621:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 47 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920511.186639:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972221056:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920511.187427:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1790920511.189964:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1877915972221056:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920511.190004:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920511.190027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.190545:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951257728 00000100:00100000:3.0:1790920511.190557:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951257728 00010000:00010000:3.0:1790920511.190610:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920511.190665:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:3.0:1790920511.190677:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+48:2354:x1877915951257728:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920511.190698:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920511.190706:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.190962:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.190995:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a000/0x2a4915844546ae60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad8e expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.191018:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:3.0:1790920511.191024:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.191036:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.191044:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.191079:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920511.191127:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.191136:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920511.191157:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+47:2354:x1877915951257728:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 480us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920511.191164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 76 00000001:00080000:0.0:1790920511.191320:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1790920511.191588:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1790920511.191743:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972221184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920511.191833:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920511.191870:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920511.191938:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972221184 00000100:00100000:3.0:1790920511.191946:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972221184 00000100:00100000:3.0:1790920511.192009:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790920511.192018:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1877915972221184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790920511.192110:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1877915972221184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920511.192118:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790920511.192172:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790920511.192184:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972221184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790920511.192899:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1790920511.192982:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972221312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790920511.193029:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920511.193113:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920511.193403:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972221312 00000100:00100000:3.0:1790920511.193413:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972221312 00000100:00100000:3.0:1790920511.193461:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790920511.193544:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1877915972221312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790920511.193819:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1877915972221312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 278us (788us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790920511.193828:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790920511.193926:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1877915972221312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790920511.194000:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1790920511.194068:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.194081:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.194089:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.194097:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920511.194103:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.194112:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.194130:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:1.0:1790920511.194134:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790920511.194139:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.194146:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aebb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790920511.194383:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790920511.194530:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1790920511.194543:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353360795533ns, next at 354360793228ns, rc = 0 00000001:00080000:1.0:1790920511.194566:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1790920511.194607:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c400) 00010000:00010000:1.0:1790920511.194611:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790920511.194619:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546aea6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadb1 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920511.194802:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+50:11564:x1877915951257600:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 9386us (10651us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790920511.194813:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00000020:00080000:1.0:1790920511.194818:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790920511.196787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920511.196878:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951257856 00000100:00100000:1.0:1790920511.196892:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951257856 00000100:00100000:2.0:1790920511.197062:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 202 00000100:00100000:2.0:1790920511.197075:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+50:11564:x1877915951257856:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920511.197106:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920511.197136:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aec2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadb8 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.197214:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aec2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadb8 expref: 51 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.197233:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aec2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadb8 expref: 51 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.197268:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920511.197272:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920511.197276:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56bc00, rc 0) 00000100:00100000:2.0:1790920511.197349:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:11564:x1877915951257856:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 275us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920511.197356:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 202 00000100:00100000:2.0:1790920511.207374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920511.207482:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951258112 00000100:00100000:1.0:1790920511.207494:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951258112 00000100:00100000:1.0:1790920511.207566:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:1.0:1790920511.207577:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+51:11564:x1877915951258112:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1790920511.207920:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11564:x1877915951258112:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 343us (558us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1790920511.207928:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:1.0:1790920511.323293:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920511.323662:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951258240 00000100:00100000:2.0:1790920511.323679:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951258240 00000100:00100000:2.0:1790920511.323940:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00100000:2.0:1790920511.323954:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11575:x1877915951258240:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:2.0:1790920511.324069:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324103:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324143:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324164:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324171:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324178:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324309:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324319:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324326:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920511.324384:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324400:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324407:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324415:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324434:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920511.324439:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324447:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324464:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920511.324467:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920511.324474:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324481:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b800/0x2a4915844546aec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324499:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324506:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324513:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324532:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920511.324536:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324541:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324560:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920511.324562:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920511.324566:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324571:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546aed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324597:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324603:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324609:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324613:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920511.324616:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324622:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324630:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920511.324633:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920511.324636:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.324641:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546aed7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920511.327623:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11575:x1877915951258240:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 3650us (4324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920511.327664:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00100000:2.0:1790920511.407564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.407690:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951258496 00000100:00100000:3.0:1790920511.407702:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951258496 00000100:00100000:3.0:1790920511.407825:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 204 00000100:00100000:3.0:1790920511.407838:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+52:11578:x1877915951258496:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920511.407859:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920511.407895:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aede lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadbf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.407975:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.407993:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408007:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408024:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408032:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408058:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408189:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546aef3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408199:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546aef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408207:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546aef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920511.408217:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790920511.408331:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408340:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408347:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408353:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920511.408358:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408366:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408378:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920511.408381:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920511.408397:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408404:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546aee5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408420:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408426:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408432:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408437:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920511.408440:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408446:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408454:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb04d19600) 00010000:00010000:3.0:1790920511.408457:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920511.408460:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408466:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546aeec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408508:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546aede lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadbf expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408535:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546aef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadbf expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.408542:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920511.408545:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920511.408547:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36a00, rc 0) 00000100:00100000:3.0:1790920511.408734:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:11578:x1877915951258496:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 897us (1191us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1790920511.408743:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 204 00000100:00100000:3.0:1790920511.417743:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920511.418002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951258624 00000100:00100000:0.0:1790920511.418016:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951258624 00000100:00100000:0.0:1790920511.418120:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 205 00000100:00100000:0.0:1790920511.418133:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:11578:x1877915951258624:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:0.0:1790920511.418235:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418270:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418285:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418319:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418328:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418336:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418343:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920511.418348:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418356:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418370:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920511.418374:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920511.418380:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.418403:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920511.418689:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:11578:x1877915951258624:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 556us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920511.418697:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 205 00000100:00100000:1.0:1790920511.422062:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920511.422185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951258880 00000100:00100000:0.0:1790920511.422201:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951258880 00000100:00100000:0.0:1790920511.422328:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:0.0:1790920511.422341:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+54:11578:x1877915951258880:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1790920511.422676:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:11578:x1877915951258880:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 336us (631us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1790920511.422685:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00010000:00010000:1.0:1790920511.532131:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920511.532238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.532378:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951259136 00000100:00100000:3.0:1790920511.532390:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951259136 00000100:00100000:3.0:1790920511.532476:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 206 00000100:00100000:3.0:1790920511.532489:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+55:11588:x1877915951259136:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1790920511.532520:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920511.532524:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790920511.532558:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546ae83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edada3 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.532582:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920511.532588:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920511.532607:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546af08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadc6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.532744:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546af0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.532847:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546af0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.533174:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546af0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920511.533193:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790920511.533408:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546af08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadc6 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.533427:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546af0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadc6 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.533436:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920511.533439:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920511.533442:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37400, rc 0) 00000100:00100000:3.0:1790920511.533587:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:11588:x1877915951259136:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1098us (1356us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1790920511.533596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 206 00000100:00100000:3.0:1790920511.539660:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920511.539804:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951259392 00000100:00100000:2.0:1790920511.539819:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951259392 00000100:00100000:2.0:1790920511.539899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 207 00000100:00100000:2.0:1790920511.539912:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+56:11588:x1877915951259392:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:2.0:1790920511.539997:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790920511.540037:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546af0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadc6 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.540065:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546aef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadbf expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.540078:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920511.540084:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920511.540376:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.540392:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.540403:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790920511.540598:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1790920511.540649:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf9a1816 reply state 000000007f970f64 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920511.540660:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920511.540832:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11588:x1877915951259392:12345-192.168.204.34@tcp:36:bash.0 Request processed in 921us (1188us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790920511.540842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 207 00000020:00080000:2.0:1790920511.540848:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790920511.545667:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.546177:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951259520 00000100:00100000:3.0:1790920511.546191:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951259520 00000100:00100000:3.0:1790920511.546277:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 208 00000100:00100000:3.0:1790920511.546291:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11588:x1877915951259520:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1790920511.546326:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920511.546355:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546af24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadcd expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.546532:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.546550:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.546560:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.546582:0:11700:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.546596:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547512:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547528:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547537:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547557:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920511.547562:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547572:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547593:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:1.0:1790920511.547597:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920511.547601:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547610:0:3290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547619:0:3290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547656:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.547665:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56b400/0x2a4915844546af1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.548153:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.548163:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920511.548294:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790920511.548308:0:11700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920511.548348:0:11700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.548401:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546af24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 58 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.548433:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 57 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.548463:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920511.548466:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920511.548470:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37800, rc 0) 00000100:00100000:3.0:1790920511.548555:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11588:x1877915951259520:12345-192.168.204.34@tcp:101:bash.0 Request processed in 2266us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920511.548563:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 208 00000100:00100000:3.0:1790920511.556513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920511.556733:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951259776 00000100:00100000:1.0:1790920511.556799:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951259776 00000100:00100000:1.0:1790920511.556876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:1.0:1790920511.556887:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+57:11588:x1877915951259776:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:1.0:1790920511.557510:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:11588:x1877915951259776:12345-192.168.204.34@tcp:35:bash.0 Request processed in 621us (1009us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790920511.557543:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:2.0:1790920511.654601:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920511.655400:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951259904 00000100:00100000:0.0:1790920511.655421:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951259904 00000100:00100000:0.0:1790920511.655572:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 209 00000100:00100000:0.0:1790920511.655586:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+58:11594:x1877915951259904:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920511.655621:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920511.655655:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadd4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.655842:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546af39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.655929:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546af39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.656065:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546af39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920511.656117:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790920511.656122:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920511.656145:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546af39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.656182:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadd4 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.656204:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546af39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadd4 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.656214:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920511.656217:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920511.656221:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52200, rc 0) 00000100:00100000:0.0:1790920511.656661:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11594:x1877915951259904:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1073us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920511.656672:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 209 00000100:00100000:2.0:1790920511.668208:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.668424:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951260032 00000100:00100000:3.0:1790920511.668437:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951260032 00000100:00100000:3.0:1790920511.668590:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 210 00000100:00100000:3.0:1790920511.668603:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11594:x1877915951260032:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920511.668630:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920511.668657:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546af40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaddb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.671983:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672025:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672044:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672087:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672096:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672126:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546af55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672561:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546af55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672568:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546af55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920511.672626:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790920511.672632:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920511.672659:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546af55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672674:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546af55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672685:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672691:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672700:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672707:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920511.672712:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.672729:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673122:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920511.673127:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920511.673136:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673143:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673159:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673164:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673170:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673175:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920511.673178:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673184:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673192:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb04d19600) 00010000:00010000:3.0:1790920511.673195:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920511.673198:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673218:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546af4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673427:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546af40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaddb expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673446:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546af55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaddb expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.673530:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920511.673534:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790920511.673537:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37e00, rc 0) 00000100:00100000:3.0:1790920511.673728:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11594:x1877915951260032:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 5124us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920511.673738:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 210 00000100:00100000:3.0:1790920511.681905:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920511.682591:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951260160 00000100:00100000:1.0:1790920511.682608:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951260160 00000100:00100000:1.0:1790920511.682710:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:1.0:1790920511.682723:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:2353:x1877915951260160:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920511.682774:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920511.682811:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546af55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaddb expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.682838:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:1.0:1790920511.682843:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920511.682923:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:2353:x1877915951260160:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 202us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920511.682930:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:2.0:1790920511.689422:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920511.692654:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951260416 00000100:00100000:1.0:1790920511.692674:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951260416 00000100:00100000:1.0:1790920511.692795:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:1.0:1790920511.692809:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11594:x1877915951260416:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920511.692840:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920511.693163:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546af5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edade2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.693387:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.693408:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 60 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.693437:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.693616:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 60 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.693635:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 60 pid: 11700 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920511.693652:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972221440:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920511.693949:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920511.705417:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1877915972221440:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920511.706389:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:1.0:1790920511.706497:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920511.707077:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951260544 00000100:00100000:0.0:1790920511.707092:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951260544 00010000:00010000:0.0:1790920511.707151:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 61 pid: 11700 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920511.707257:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:0.0:1790920511.707281:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:2355:x1877915951260544:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920511.707322:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920511.707331:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 61 pid: 11700 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.707347:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 61 pid: 11700 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.707375:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546af2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadcd expref: 61 pid: 11700 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.707395:0:8460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920511.707400:0:8460:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.707412:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.707421:0:8460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.707469:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920511.707555:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:2355:x1877915951260544:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 286us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920511.707564:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 77 00010000:00010000:1.0:1790920511.708675:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.708692:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920511.708720:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790920511.709000:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546af5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.709025:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920511.709062:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:1.0:1790920511.709066:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790920511.709069:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443da00, rc 0) 00000100:00100000:1.0:1790920511.709141:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11594:x1877915951260416:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 16335us (19734us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1790920511.709151:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:2.0:1790920511.715556:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.716156:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951260800 00000100:00100000:3.0:1790920511.716171:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951260800 00000100:00100000:2.0:1790920511.716547:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:2.0:1790920511.716560:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11594:x1877915951260800:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:2.0:1790920511.716585:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920511.716620:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56bc00/0x2a4915844546aec2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadb8 expref: 60 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920511.716645:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920511.716651:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920511.716728:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11594:x1877915951260800:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 171us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920511.716737:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:2.0:1790920511.720388:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920511.720618:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951260928 00000100:00100000:3.0:1790920511.720632:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951260928 00000100:00100000:3.0:1790920511.720704:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:3.0:1790920511.720718:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb070e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11594:x1877915951260928:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:3.0:1790920511.721094:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.721121:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920511.721156:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790920511.721427:0:11700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1790920511.721735:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb070e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11594:x1877915951260928:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 1016us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920511.721773:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:2.0:1790920511.729721:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920511.730097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951261056 00000100:00100000:0.0:1790920511.730113:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951261056 00000100:00100000:0.0:1790920511.730232:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 213 00000100:00100000:0.0:1790920511.730257:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+59:11594:x1877915951261056:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920511.730374:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920511.730406:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edade9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.730561:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.730574:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.730597:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.730612:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.730628:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920511.730632:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790920511.730635:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920511.730643:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52a00, rc 0) 00000100:00100000:0.0:1790920511.730790:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11594:x1877915951261056:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 546us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920511.730798:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 213 00010000:00010000:3.0:1790920512.553126:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920512.617945:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972221952:0@lo:400:kworker.0 00000100:00100000:0.0:1790920512.618045:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920512.618135:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920512.618143:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972221824:0@lo:400:kworker.0 00000100:00100000:0.0:1790920512.618173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920512.618453:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972221952 00000100:00100000:3.0:1790920512.618470:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972221952 00000100:00100000:3.0:1790920512.618560:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790920512.618573:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972221952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920512.618647:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972221952:12345-0@lo:400:kworker.0 Request processed in 77us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920512.618656:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790920512.618710:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972221952:0@lo:400:kworker.0 00000100:00080000:0.0:1790920512.618953:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920512.622054:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972221696:0@lo:400:kworker.0 00000100:00100000:2.0:1790920512.622190:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920512.622258:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972222208:0@lo:400:kworker.0 00000100:00100000:2.0:1790920512.622295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920512.622333:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790920512.622341:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972221568:0@lo:400:kworker.0 00000100:00100000:2.0:1790920512.622372:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920512.622398:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972222080:0@lo:400:kworker.0 00000100:00100000:2.0:1790920512.622422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920512.622463:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972221568 00000100:00100000:2.0:1790920512.622473:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972221568 00000100:00100000:2.0:1790920512.622535:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1790920512.622545:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972221568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920512.622611:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3305:x1877915972221568:12345-0@lo:400:kworker.0 Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920512.622618:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1790920512.622683:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972221568:0@lo:400:kworker.0 00000100:00100000:2.0:1790920512.622713:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972221824 00000100:00100000:2.0:1790920512.622717:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972221824 00000100:00100000:2.0:1790920512.622777:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972221696 00000100:00100000:2.0:1790920512.622781:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972221696 00000100:00100000:2.0:1790920512.622793:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972222080 00000100:00100000:2.0:1790920512.622796:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972222080 00000100:00100000:2.0:1790920512.622811:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790920512.622817:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972221824:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790920512.623063:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920512.623080:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790920512.623091:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920512.623145:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972221696:12345-0@lo:400:kworker.0 Request processed in 58us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920512.623152:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790920512.623170:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790920512.623177:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972222080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920512.623209:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972222080:12345-0@lo:400:kworker.0 Request processed in 34us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920512.623214:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790920512.623288:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972222080:0@lo:400:kworker.0 00000100:00100000:0.0:1790920512.623298:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972221696:0@lo:400:kworker.0 00000100:00100000:2.0:1790920512.623399:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972221824:12345-0@lo:400:kworker.0 Request processed in 581us (5223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920512.623419:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790920512.623513:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972222208 00000100:00100000:1.0:1790920512.623518:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972222208 00000100:00100000:1.0:1790920512.623565:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790920512.623574:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1877915972222208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920512.623625:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1877915972222208:12345-0@lo:400:kworker.0 Request processed in 52us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920512.623630:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790920512.623857:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972222208:0@lo:400:kworker.0 00000100:00100000:0.0:1790920512.625087:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972221824:0@lo:400:kworker.0 00000040:00080000:2.0:1790920512.681177:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920512.681191:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920512.681261:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1790920512.681269:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790920512.681435:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972222336:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790920512.681601:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88ea03784600 going to sleep for 11 seconds 00000100:00100000:3.0:1790920512.685402:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972222336:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790920512.688183:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920512.688436:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951261184 00000100:00100000:0.0:1790920512.688450:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951261184 00000100:00100000:0.0:1790920512.688547:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 214 00000100:00100000:0.0:1790920512.688560:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11595:x1877915951261184:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790920512.688604:0:11700:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790920512.689314:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11595:x1877915951261184:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 751us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920512.689342:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 214 00000100:00080000:1.0:1790920512.690544:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920512.698021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920512.699348:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951261312 00000100:00100000:2.0:1790920512.699368:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951261312 00000100:00100000:2.0:1790920512.699465:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00100000:2.0:1790920512.699478:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11595:x1877915951261312:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790920512.699578:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699600:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699614:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699630:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699637:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699644:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699688:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699697:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.699703:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920512.700344:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790920512.700352:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920512.700370:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700384:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700392:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700400:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700407:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920512.700412:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700421:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700435:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920512.700449:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920512.700456:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700464:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a400/0x2a4915844546af7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700480:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700487:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700493:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700499:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ba00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920512.700502:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700509:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700517:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff88eb2cb2c400) 00010000:00010000:2.0:1790920512.700520:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920512.700523:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546af86 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700552:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700563:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700569:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700574:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ae00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920512.700577:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700582:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700590:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920512.700592:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920512.700596:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.700602:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546af8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920512.702104:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11595:x1877915951261312:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 1237us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920512.702124:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00100000:3.0:1790920512.704250:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920512.704394:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951261568 00000100:00100000:0.0:1790920512.704408:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951261568 00000100:00100000:0.0:1790920512.704482:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:0.0:1790920512.704495:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+60:11595:x1877915951261568:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920512.704524:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920512.704554:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546af94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadf0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.704699:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.704742:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.704883:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920512.704900:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790920512.705022:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705076:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705085:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705092:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920512.705098:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705126:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705142:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920512.705145:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790920512.705152:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705159:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546af9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705216:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546af94 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadf0 expref: 62 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.705241:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:0.0:1790920512.705244:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000001:00080000:2.0:1790920512.705645:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1790920512.705665:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1790920512.705684:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:0.0:1790920512.706383:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546af94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadf0 expref: 62 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.706406:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53400, rc 0) 00000100:00100000:0.0:1790920512.706508:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:11595:x1877915951261568:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 2015us (2270us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1790920512.706519:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:1.0:1790920512.711903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920512.712046:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951261696 00000100:00100000:3.0:1790920512.712061:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951261696 00000100:00100000:3.0:1790920512.712142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 217 00000100:00100000:3.0:1790920512.712155:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:11595:x1877915951261696:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790920512.712205:0:5846:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790920512.712366:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:11595:x1877915951261696:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 213us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920512.712393:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 217 00000100:00100000:3.0:1790920512.715707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920512.716025:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951261952 00000100:00100000:0.0:1790920512.716038:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951261952 00000100:00100000:0.0:1790920512.716113:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00100000:0.0:1790920512.716123:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:11595:x1877915951261952:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920512.716173:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920512.716177:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790920512.716216:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546af39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadd4 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.716248:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920512.716254:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920512.716271:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546afa9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadf7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790920512.716890:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1790920512.717159:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546afb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.717177:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546afb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.717190:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546afb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.717273:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546afa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadf7 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.717293:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546afb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadf7 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.717302:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856fd00) 00010000:00010000:0.0:1790920512.717305:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920512.717317:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52600, rc 0) 00000100:00100000:0.0:1790920512.717413:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+62:11595:x1877915951261952:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1290us (1720us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1790920512.717422:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00100000:0.0:1790920512.724478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920512.724552:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951262208 00000100:00100000:3.0:1790920512.724565:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951262208 00000100:00100000:3.0:1790920512.724640:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 219 00000100:00100000:3.0:1790920512.724651:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+62:11595:x1877915951262208:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790920512.724722:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920512.724796:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52600/0x2a4915844546afb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadf7 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.724821:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856fd00) 00010000:00010000:3.0:1790920512.724845:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920512.724877:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.724895:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.724907:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725231:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725253:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725269:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725390:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725398:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725404:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725410:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920512.725414:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725420:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725433:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:3.0:1790920512.725436:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920512.725442:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725448:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725462:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725468:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725474:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725485:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920512.725488:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725495:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725503:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb52fc62f (ffff88eb04d19d00) 00010000:00010000:3.0:1790920512.725505:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920512.725508:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.725513:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36800/0x2a4915844546afc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb52fc62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920512.725635:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:11595:x1877915951262208:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 980us (1171us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790920512.725645:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 219 00000100:00100000:3.0:1790920512.738899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920512.739301:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951262336 00000100:00100000:0.0:1790920512.739317:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951262336 00000100:00100000:0.0:1790920512.739392:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 220 00000100:00100000:0.0:1790920512.739403:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+61:11595:x1877915951262336:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920512.739430:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920512.739457:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546afcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edadfe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.739503:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.739520:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.739534:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.739668:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546afcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.739690:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.739699:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:0.0:1790920512.739709:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790920512.739725:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52200, rc 0) 00000100:00100000:0.0:1790920512.740505:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+62:11595:x1877915951262336:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1096us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920512.740517:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 220 00000100:00100000:1.0:1790920512.744445:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920512.744992:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951262592 00000100:00100000:2.0:1790920512.745006:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951262592 00000100:00100000:2.0:1790920512.745137:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 221 00000100:00100000:2.0:1790920512.745150:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+62:11595:x1877915951262592:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790920512.745309:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.745331:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.745346:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790920512.745684:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1790920512.745697:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354911948985ns, next at 355911945999ns, rc = 0 00000004:00010000:2.0:1790920512.745898:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067aa5e5d reply state 0000000078ef1b22 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920512.745910:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920512.746047:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+64:11595:x1877915951262592:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 896us (1613us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790920512.746056:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 221 00010000:00010000:0.0:1790920512.753521:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.753547:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.753558:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.753565:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ae00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920512.753571:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.753581:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.753605:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:0.0:1790920512.753609:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790920512.753616:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920512.753623:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ae00/0x2a4915844546afda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920512.758456:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920512.758558:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951262720 00000100:00100000:2.0:1790920512.758572:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951262720 00000100:00100000:2.0:1790920512.758653:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 222 00000100:00100000:2.0:1790920512.758665:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+63:11595:x1877915951262720:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920512.758697:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920512.758724:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae05 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.765183:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 64 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.765287:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 64 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.765458:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:3.0:1790920512.765463:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790920512.765469:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ba00, rc 0) 00000100:00100000:3.0:1790920512.765577:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+64:11595:x1877915951262720:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 6912us (7132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920512.765589:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 222 00000100:00100000:1.0:1790920512.774981:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920512.777137:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951262848 00000100:00100000:3.0:1790920512.777159:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951262848 00000100:00100000:3.0:1790920512.777309:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:3.0:1790920512.777323:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2354:x1877915951262848:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1790920512.777354:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920512.778111:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2354:x1877915951262848:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 785us (3138us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790920512.778124:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:0.0:1790920512.786704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920512.786974:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951263104 00000100:00100000:1.0:1790920512.786991:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951263104 00000100:00100000:1.0:1790920512.787071:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:1.0:1790920512.787084:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+64:11595:x1877915951263104:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790920512.787911:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+65:11595:x1877915951263104:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 823us (1216us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1790920512.787923:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:1.0:1790920512.800923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920512.801067:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951263360 00000100:00100000:3.0:1790920512.801081:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951263360 00000100:00100000:3.0:1790920512.801214:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 223 00000100:00100000:3.0:1790920512.801239:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+65:11595:x1877915951263360:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790920512.801395:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+65:11595:x1877915951263360:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 160us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920512.801404:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 223 00000100:00100000:0.0:1790920512.805970:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920512.806211:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951263488 00000100:00100000:3.0:1790920512.806237:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951263488 00000100:00100000:3.0:1790920512.806311:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 224 00000100:00100000:3.0:1790920512.806323:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+65:11595:x1877915951263488:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790920512.806352:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920512.806380:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae0c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.806485:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546afef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.806504:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.806519:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920512.806580:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920512.806607:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.806639:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37800/0x2a4915844546afe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae0c expref: 67 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.806663:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546afef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae0c expref: 66 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.806673:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:3.0:1790920512.806676:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790920512.806681:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36c00, rc 0) 00000100:00100000:3.0:1790920512.807069:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+66:11595:x1877915951263488:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 744us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920512.807077:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 224 00000100:00100000:0.0:1790920512.810117:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920512.810243:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951263616 00000100:00100000:1.0:1790920512.810257:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951263616 00000100:00100000:1.0:1790920512.810329:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:1.0:1790920512.810342:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+10:2353:x1877915951263616:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790920512.810373:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920512.810402:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae13 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790920512.810436:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf4740, blocks: 0x1 00010000:00010000:1.0:1790920512.811602:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1790920512.811615:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920512.811631:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920512.811659:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920512.811677:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443dc00, rc 0) 00000100:00100000:0.0:1790920512.822635:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:2353:x1877915951263616:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 12278us (12515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920512.822651:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:0.0:1790920512.829656:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920512.829812:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951263872 00000100:00100000:2.0:1790920512.829825:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951263872 00000100:00100000:2.0:1790920512.829904:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 225 00000100:00100000:2.0:1790920512.829916:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+66:11595:x1877915951263872:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790920512.830058:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+66:11595:x1877915951263872:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 143us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920512.830067:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 225 00000100:00100000:0.0:1790920512.837175:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920512.837286:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951264000 00000100:00100000:3.0:1790920512.837300:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951264000 00000100:00100000:3.0:1790920512.837366:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:3.0:1790920512.837377:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:11595:x1877915951264000:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790920512.837403:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920512.837427:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae1a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.837475:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.837510:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790920512.837516:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920512.837522:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.837563:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.837578:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 12 pid: 6690 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920512.837594:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972222464:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920512.837704:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb050e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1790920512.845728:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972222464:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920512.845822:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.845861:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37800, rc 0) 00000100:00100000:3.0:1790920512.845937:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:11595:x1877915951264000:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 8559us (8774us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920512.845947:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:1.0:1790920512.846246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920512.846391:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951264128 00000100:00100000:2.0:1790920512.846401:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951264128 00010000:00010000:2.0:1790920512.846444:0:8460:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 12 pid: 6690 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920512.846500:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:2.0:1790920512.846511:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+12:2354:x1877915951264128:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920512.846530:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920512.846563:0:8460:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 12 pid: 6690 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.846578:0:8460:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 12 pid: 6690 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.846640:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e297fee/0x2a4915844546aff6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae13 expref: 12 pid: 6690 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.846660:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920512.846665:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920512.846675:0:8460:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.846687:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920512.846731:0:8460:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920512.846790:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8460:1877915972222592:192.168.204.34@tcp:105: 00000100:00100000:2.0:1790920512.846891:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb106dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920512.861862:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8460:1877915972222592:192.168.204.34@tcp:105: 00010000:00010000:2.0:1790920512.861900:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920512.861993:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:2354:x1877915951264128:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 15482us (15746us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920512.862010:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:0.0:1790920512.863857:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920512.868103:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951264256 00000100:00100000:1.0:1790920512.868121:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951264256 00002000:00100000:1.0:1790920512.868191:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88eb3a90b100 x1877915951264256/t0(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:123/0 lens 504/0 e 0 to 0 dl 1790920523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920512.868229:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3a90b100 with x1877915951264256 ext(0->12) 00002000:00010000:1.0:1790920512.868236:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3a90b100 00000100:00100000:1.0:1790920512.868279:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1790920512.868301:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+11:2355:x1877915951264256:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790920512.868856:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:2355:x1877915951264256:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 565us (5006us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790920512.868879:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00002000:00100000:1.0:1790920512.868888:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88eb3a90b100 x1877915951264256/t4294967320(0) o4->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:123/0 lens 504/448 e 0 to 0 dl 1790920523 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920512.868897:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3a90b100 with x1877915951264256 ext(0->12) 00002000:00010000:1.0:1790920512.868902:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3a90b100 00000100:00100000:0.0:1790920512.873573:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920512.873705:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951264384 00000100:00100000:1.0:1790920512.873719:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951264384 00000100:00100000:1.0:1790920512.873840:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 226 00000100:00100000:1.0:1790920512.873853:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+66:11595:x1877915951264384:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790920512.967513:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:2.0:1790920512.967547:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88eb3f681b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1790920512.967554:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb03205e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88eb3f681540 00000020:00080000:2.0:1790920512.967574:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb03205400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb33f46c00 00000001:00080000:2.0:1790920512.967602:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1790920512.967627:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1790920512.967645:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1790920512.967677:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:2.0:1790920512.967706:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88eb058f1d80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1790920512.967709:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3faf0500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88eb058f1000 00000020:00080000:2.0:1790920512.967712:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3faf0a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb3fe75800 00000020:00080000:3.0:1790920512.968134:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1790920512.968378:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790920512.968435:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972222720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790920512.968531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920512.968629:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972222720 00000100:00100000:3.0:1790920512.968640:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972222720 00000100:00100000:3.0:1790920512.968696:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790920512.968707:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972222720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790920512.968743:0:8267:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1790920512.968815:0:8267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abf473f, atime: 0x6abf473f, ctime: 0x6abf473f, blocks: 0xb 00010000:00010000:3.0:1790920512.968838:0:8267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.968859:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1790920512.968865:0:8267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920512.968873:0:8267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.968893:0:8267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.968905:0:8267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.968913:0:8267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.968936:0:8267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790920512.969513:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1877915972222720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 806us (981us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790920512.969528:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1790920512.969560:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920512.969567:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.969578:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920512.969583:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.969594:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.969615:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.969623:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c92604d/0x2a4915844546b004 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.969645:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920512.969647:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920512.969648:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920512.969683:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1790920512.969690:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb3af2c380, transno 4294967307 00000004:00080000:3.0:1790920512.969702:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1790920512.969726:0:3306:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88eb34251c00 x1877915972222720/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790920528 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1790920512.969737:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb34251c00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790920512.969794:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972222720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790920512.970415:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11595:x1877915951264384:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 96556us (96850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920512.970427:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 226 00000100:00100000:0.0:1790920512.970585:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972222976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790920512.970638:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920512.970699:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972222976 00000100:00100000:0.0:1790920512.970706:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972222976 00000100:00100000:0.0:1790920512.970782:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790920512.970792:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972222976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790920512.970962:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790920512.970966:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790920513 00002000:00010000:0.0:1790920512.970969:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790920512.970971:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790920512 -> 1790920513 00002000:00010000:0.0:1790920512.970974:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790920512.971008:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1877915972222976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (370us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1790920512.971015:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1790920512.971051:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb3a90aa00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1790920512.971058:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972222976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790920512.971087:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972222848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790920512.971116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920512.971795:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972222848 00000100:00100000:3.0:1790920512.971805:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972222848 00000100:00100000:3.0:1790920512.971859:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920512.971868:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1877915972222848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790920512.971894:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1790920512.971918:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.971943:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.971952:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1790920512.971956:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920512.971962:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.972000:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.972015:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 12 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920512.972028:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972223104:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920512.972099:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920512.978918:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920512.978951:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920512.979035:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951264512 00000100:00100000:2.0:1790920512.979048:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951264512 00000100:00100000:2.0:1790920512.979124:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:2.0:1790920512.979137:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+13:2354:x1877915951264512:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790920512.979337:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951264640 00000100:00100000:3.0:1790920512.979360:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951264640 00010000:00010000:3.0:1790920512.979391:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 14 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920512.979435:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:3.0:1790920512.979443:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2355:x1877915951264640:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920512.979629:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920512.979637:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 14 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.979655:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 14 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.979689:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920512.979694:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790920512.979702:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.979715:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.979741:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920512.979852:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+14:2355:x1877915951264640:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 409us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920512.979862:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00010000:00010000:1.0:1790920512.981360:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546adc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad79 expref: 13 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920512.981388:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972223104:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920512.981420:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920512.981433:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920512.981826:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920512.981856:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920512.981865:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920512.981891:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920512.982608:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920512.982619:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.982639:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920512.982646:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.982659:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.982685:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.982692:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b00b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920512.982720:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920512.982722:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920512.982725:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920512.985010:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3307:x1877915972222848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13127us (13878us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1790920512.985027:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1790920512.985327:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb3a908700/2, rc 0, transno 4294967322 00000100:00100000:2.0:1790920512.985338:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972222848:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1790920513.064655:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1790920513.064695:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:1.0:1790920513.064709:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1790920513.074718:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951264512:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 95571us (95803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920513.074734:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:0.0:1790920513.084254:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920513.084570:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951264896 00000100:00100000:2.0:1790920513.084581:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951264896 00000100:00100000:2.0:1790920513.084638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 227 00000100:00100000:2.0:1790920513.084649:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11595:x1877915951264896:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790920513.085361:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920513.085637:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36c00/0x2a4915844546afef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae0c expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.085695:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:2.0:1790920513.085700:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920513.085729:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.085742:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.086201:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920513.090177:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f146a6a reply state 000000005e0f0798 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920513.090199:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920513.090369:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:11595:x1877915951264896:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 5718us (6121us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1790920513.090379:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 227 00010000:00010000:1.0:1790920513.092836:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.092863:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.092873:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.092880:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920513.092888:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.092919:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.092942:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:1.0:1790920513.092945:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920513.092951:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.092957:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ac00/0x2a4915844546b012 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920513.094288:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.094779:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951265024 00000100:00100000:3.0:1790920513.094791:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951265024 00000100:00100000:3.0:1790920513.094841:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:3.0:1790920513.094851:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951265024:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790920513.095189:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790920513.095193:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790920513 -> 1790920511 00002000:00010000:3.0:1790920513.095196:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790920511 00002000:00010000:3.0:1790920513.095198:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790920513 -> 1790920511 00002000:00010000:3.0:1790920513.095201:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790920513.099814:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2354:x1877915951265024:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 4949us (5532us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1790920513.099829:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:3.0:1790920513.122704:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920513.123975:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951265280 00000100:00100000:0.0:1790920513.123990:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951265280 00000100:00100000:0.0:1790920513.124091:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 228 00000100:00100000:0.0:1790920513.124103:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11595:x1877915951265280:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790920513.124176:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.124195:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.124205:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.124265:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.124280:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 20 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920513.124294:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a90ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972223232:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920513.124404:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920513.133935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920513.134432:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951265408 00000100:00100000:1.0:1790920513.134444:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951265408 00010000:00010000:1.0:1790920513.134618:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 21 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920513.134664:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:1.0:1790920513.134676:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:2354:x1877915951265408:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920513.134694:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920513.134704:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 21 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.134724:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 21 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.134786:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:1.0:1790920513.134793:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.134834:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52200/0x2a4915844546afd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edadfe expref: 21 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.134838:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.134878:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920513.134889:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a90ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972223232:192.168.204.34@tcp:104: 00010000:00010000:1.0:1790920513.134910:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790920513.134928:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.134944:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.134951:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920513.134987:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:2354:x1877915951265408:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 310us (1060us total) trans 0 rc 0/0 00010000:00010000:3.0:1790920513.134994:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.135005:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.135013:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.135020:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920513.135025:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.135034:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.135048:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:3.0:1790920513.135066:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790920513.135072:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.135080:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b019 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920513.135153:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:11595:x1877915951265280:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 11051us (12478us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790920513.135162:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 228 00000100:00100000:1.0:1790920513.135705:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:2.0:1790920513.139336:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920513.139358:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972223360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920513.139445:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920513.142556:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972223360 00000100:00100000:3.0:1790920513.142584:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972223360 00000100:00100000:3.0:1790920513.142702:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790920513.142717:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972223360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790920513.142802:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1790920513.142934:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972223360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (3488us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920513.142944:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790920513.143030:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1790920513.143056:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1790920513.143097:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb3a90aa00, transno 4294967321 00000100:00100000:2.0:1790920513.143122:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88eb3a908700 x1877915972222848/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790920528 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920513.143147:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972223360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920513.147672:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920513.159087:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951265536 00000100:00100000:1.0:1790920513.159105:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951265536 00000100:00100000:0.0:1790920513.159647:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:0.0:1790920513.159659:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951265536:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790920513.159712:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.159734:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.159744:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920513.159784:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790920513.159789:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.159828:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.159843:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 8 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920513.159857:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972223488:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920513.159947:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681480 going to sleep for 11 seconds 00000100:00100000:3.0:1790920513.188699:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.188806:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.188846:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.188918:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.188986:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877915972223488:192.168.204.34@tcp:104: 00000100:00100000:2.0:1790920513.189019:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951266048 00010000:00010000:3.0:1790920513.189024:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920513.189054:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951266048 00000100:00100000:3.0:1790920513.189086:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951265920 00000100:00100000:3.0:1790920513.189095:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951265920 00010000:00010000:2.0:1790920513.189109:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 9 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920513.189173:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:2.0:1790920513.189191:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+9:2355:x1877915951266048:12345-192.168.204.34@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790920513.189203:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00100000:3.0:1790920513.189229:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951265920:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920513.189335:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2352:x1877915951265920:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 121us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920513.189343:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00080000:3.0:1790920513.189369:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920513.189986:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951265792 00000100:00100000:0.0:1790920513.189995:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951265792 00000100:00100000:0.0:1790920513.190062:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:0.0:1790920513.190071:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951265792:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920513.190132:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951265792:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 62us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920513.190150:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00080000:3.0:1790920513.190396:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790920513.191402:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920513.191470:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 9 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.191491:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 9 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.191518:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8b60fc8/0x2a4915844546affd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae1a expref: 9 pid: 6689 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.191710:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920513.191715:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790920513.191720:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.191796:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.191830:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920513.191892:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2355:x1877915951266048:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 2707us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920513.191902:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 81 00010000:00010000:2.0:1790920513.194796:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194818:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194874:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194884:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194895:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194902:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920513.194907:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194944:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194967:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920513.194974:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b020 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920513.195921:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951265536:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 36256us (48254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920513.195935:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:1.0:1790920513.197384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951265664 00000100:00100000:1.0:1790920513.197397:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951265664 00000100:00100000:1.0:1790920513.202203:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 300 00000100:00100000:1.0:1790920513.202237:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951265664:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920513.202783:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2352:x1877915951265664:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 555us (13973us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920513.202792:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 300 00000100:00100000:0.0:1790920513.203159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920513.205698:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951266304 00000100:00100000:1.0:1790920513.205715:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951266304 00000100:00100000:0.0:1790920513.207784:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 229 00000100:00100000:0.0:1790920513.207800:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:11595:x1877915951266304:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790920513.207898:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.207917:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.207928:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.208140:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.208152:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 20 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.208161:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.208198:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 20 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.208225:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 20 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920513.208239:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972223616:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920513.208358:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920513.215563:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920513.215806:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972223616:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920513.215845:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920513.216018:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951266432 00000100:00100000:1.0:1790920513.216026:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951266432 00010000:00010000:1.0:1790920513.216063:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 21 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920513.216098:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:1.0:1790920513.216108:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:2354:x1877915951266432:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920513.216140:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920513.216149:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 21 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.216162:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 21 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.216186:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56ba00/0x2a4915844546afe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae05 expref: 21 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.216204:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:1.0:1790920513.216209:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.216232:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.216241:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920513.216267:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920513.216319:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:2354:x1877915951266432:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 212us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920513.216326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 82 00010000:00010000:0.0:1790920513.217035:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.217046:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920513.217287:0:11700:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790920513.217998:0:11700:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1790920513.218063:0:11700:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1790920513.218157:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11700:1877915972223744:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790920513.218243:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920513.218320:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681540 going to sleep for 11 seconds 00000100:00100000:2.0:1790920513.218667:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972223744 00000100:00100000:2.0:1790920513.218676:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972223744 00000100:00100000:2.0:1790920513.218730:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920513.218738:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11700:x1877915972223744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790920513.218865:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11700:x1877915972223744:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920513.218872:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920513.218923:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a90aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11700:1877915972223744:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1790920513.219431:0:11700:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1790920513.219502:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3447ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11700:1877915972223872:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790920513.221330:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920513.221392:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920513.221724:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972223872 00000100:00100000:0.0:1790920513.221733:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972223872 00000100:00100000:0.0:1790920513.221807:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790920513.221816:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11700:x1877915972223872:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790920513.222096:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11700:x1877915972223872:12345-0@lo:1000:mdt00_003.0 Request processed in 281us (772us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790920513.222105:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790920513.222289:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3447ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11700:1877915972223872:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790920513.222333:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222343:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222351:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222357:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920513.222361:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222368:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222383:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856f200) 00010000:00010000:3.0:1790920513.222386:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790920513.222391:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222397:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53400/0x2a4915844546b02e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222440:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222455:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222462:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222467:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920513.222470:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222476:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222484:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920513.222487:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790920513.222494:0:11700:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222507:0:11700:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222515:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.222559:0:11700:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920513.222588:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972224000:192.168.204.34@tcp:105: 00000100:00100000:3.0:1790920513.222673:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1790920513.230834:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11700:1877915972224000:192.168.204.34@tcp:105: 00010000:00010000:3.0:1790920513.230869:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230880:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546af71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230913:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230927:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230940:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230952:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230958:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230965:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.230971:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920513.230976:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231013:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231027:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920513.231031:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920513.231036:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231043:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b035 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231053:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231060:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231066:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231072:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920513.231075:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231081:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231089:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920513.231092:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790920513.231095:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.231110:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920513.231373:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:11595:x1877915951266304:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 23576us (28213us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1790920513.231384:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 229 00000020:00080000:3.0:1790920513.231390:0:11700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790920513.231901:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920513.231907:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920513.232413:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790920513.232423:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790920513.237367:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920513.237665:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951266560 00000100:00100000:1.0:1790920513.237675:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951266560 00000100:00100000:1.0:1790920513.237740:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:1.0:1790920513.238001:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:11594:x1877915951266560:12345-192.168.204.34@tcp:49:lfs.0 00000100:00100000:1.0:1790920513.238159:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:11594:x1877915951266560:12345-192.168.204.34@tcp:49:lfs.0 Request processed in 163us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920513.238166:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:0.0:1790920513.246654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.246842:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951266816 00000100:00100000:3.0:1790920513.246854:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951266816 00000100:00100000:3.0:1790920513.246925:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 230 00000100:00100000:3.0:1790920513.246936:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:11594:x1877915951266816:12345-192.168.204.34@tcp:58:lfs.0 00000040:00080000:3.0:1790920513.247337:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1790920513.247434:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:11594:x1877915951266816:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 498us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920513.247442:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 230 00000100:00100000:2.0:1790920513.250622:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920513.255830:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951267072 00000100:00100000:0.0:1790920513.255848:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951267072 00000100:00100000:0.0:1790920513.255922:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:0.0:1790920513.255949:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+23:11595:x1877915951267072:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790920513.257840:0:5848:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790920513.257980:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1790920513.258051:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.258068:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.258080:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.258089:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.258096:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.258103:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.258132:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920513.258225:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920513.258232:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920513.258263:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+25:11595:x1877915951267072:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 2313us (7647us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790920513.258274:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000020:00080000:0.0:1790920513.258280:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790920513.259786:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920513.259793:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.259804:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.259830:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88eb0856fe00) 00010000:00010000:3.0:1790920513.259833:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790920513.259854:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.259860:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b03c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.259893:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920513.259896:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920513.259898:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920513.317377:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.317511:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951267200 00000100:00100000:3.0:1790920513.317537:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951267200 00000100:00100000:3.0:1790920513.317622:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 231 00000100:00100000:3.0:1790920513.317635:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+25:11597:x1877915951267200:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920513.317667:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920513.317694:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b043 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae21 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.317815:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.317842:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.317854:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.317871:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.317887:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.317915:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.318179:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.318191:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.318199:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.318251:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.318267:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 26 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920513.318282:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972224128:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920513.318381:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1790920513.321595:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1877915972224128:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920513.321635:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920513.327348:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920513.327597:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951267456 00000100:00100000:1.0:1790920513.327612:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951267456 00000100:00100000:1.0:1790920513.327677:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:1.0:1790920513.327688:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:6053:x1877915951267456:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790920513.328173:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:6053:x1877915951267456:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 485us (830us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1790920513.328181:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:2.0:1790920513.348875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920513.349188:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951267584 00000100:00100000:3.0:1790920513.349199:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951267584 00010000:00010000:3.0:1790920513.349267:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 28 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920513.349329:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:3.0:1790920513.349338:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:2354:x1877915951267584:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920513.349356:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920513.349363:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 28 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.349375:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 28 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.349395:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546af63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade2 expref: 28 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.349412:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:3.0:1790920513.349418:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.349427:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.349434:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920513.349462:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920513.349659:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349680:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920513.349721:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790920513.349725:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920513.349772:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349785:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349795:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349801:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349807:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349813:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920513.349817:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349836:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349844:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:0.0:1790920513.349847:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920513.349851:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349866:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36200/0x2a4915844546b04a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349878:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349884:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349890:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349895:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920513.349898:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349903:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349911:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88eb04d19d00) 00010000:00010000:0.0:1790920513.349913:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920513.349916:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349921:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37c00/0x2a4915844546b051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349959:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b043 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae21 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349972:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae21 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920513.349988:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920513.349990:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920513.349992:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37200, rc 0) 00000100:00100000:3.0:1790920513.350279:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+27:2354:x1877915951267584:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 940us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920513.350287:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:0.0:1790920513.353801:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11597:x1877915951267200:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 36155us (36424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920513.353815:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 231 00010000:00010000:0.0:1790920513.586486:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790920514.288076:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790920514.288101:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790920514.288158:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790920514.288169:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790920514.289636:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972224256:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790920514.290581:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb20b70000 going to sleep for 11 seconds 00000100:00100000:2.0:1790920514.317227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920514.318221:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1877915972224256:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790920514.318270:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951267712 00000100:00100000:1.0:1790920514.318279:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951267712 00000100:00100000:1.0:1790920514.318367:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 232 00000100:00100000:1.0:1790920514.318379:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11608:x1877915951267712:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790920514.318418:0:5846:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790920514.320012:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11608:x1877915951267712:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 1626us (2785us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920514.320025:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 232 00000100:00080000:2.0:1790920514.320355:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920514.332333:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920514.332741:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951267968 00000100:00100000:0.0:1790920514.332791:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951267968 00000100:00100000:0.0:1790920514.332855:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 233 00000100:00100000:0.0:1790920514.332866:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+26:11608:x1877915951267968:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920514.332890:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920514.332912:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b05f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae28 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.333012:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b066 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.333027:0:11700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.333040:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920514.333051:0:11700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790920514.335429:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b05f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae28 expref: 29 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.335460:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae28 expref: 28 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.335470:0:11700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920514.335473:0:11700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920514.335477:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52e00, rc 0) 00000100:00100000:0.0:1790920514.335558:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:11608:x1877915951267968:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 2693us (3235us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1790920514.335566:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 233 00000100:00100000:2.0:1790920514.352880:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920514.352994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920514.353427:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951268224 00000100:00100000:0.0:1790920514.353440:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951268224 00000100:00100000:0.0:1790920514.353590:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 234 00000100:00100000:0.0:1790920514.353602:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:11608:x1877915951268224:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790920514.354074:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.354093:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.354104:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920514.354217:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951268352 00000100:00100000:1.0:1790920514.354222:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951268352 00000100:00100000:1.0:1790920514.354265:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:1.0:1790920514.354272:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+30:2354:x1877915951268352:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920514.354282:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920514.354408:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b066 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae28 expref: 30 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.361169:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.361200:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920514.361257:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:1.0:1790920514.361266:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920514.361614:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.361622:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920514.361627:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.361637:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920514.362113:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:2354:x1877915951268352:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 7834us (9112us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920514.362125:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00010000:00010000:0.0:1790920514.362534:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920514.362539:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790920514.362546:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.362553:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b074 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920514.362975:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:11608:x1877915951268224:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 9374us (10104us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1790920514.362985:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 234 00000040:00080000:3.0:1790920514.363254:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790920514.363259:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790920514.366418:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790920514.366442:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790920514.375636:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920514.379573:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951268608 00000100:00100000:1.0:1790920514.379591:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951268608 00000100:00100000:1.0:1790920514.379669:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:1.0:1790920514.379680:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+28:11608:x1877915951268608:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790920514.379968:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:11608:x1877915951268608:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 288us (4346us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790920514.379977:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00000040:00080000:2.0:1790920514.501079:0:12475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920514.501089:0:12475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920514.501134:0:12475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790920514.501141:0:12475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790920514.601009:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920514.668918:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972224384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920514.668989:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920514.669066:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972224384 00000100:00100000:1.0:1790920514.669073:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972224384 00000100:00100000:1.0:1790920514.669128:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790920514.669137:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877915972224384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920514.669175:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920514.669235:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1877915972224384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920514.669242:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790920514.669264:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920514.669301:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972224384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920514.700306:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920514.700338:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951268864 00000100:00100000:1.0:1790920514.700348:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951268864 00000100:00100000:1.0:1790920514.700401:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 235 00000100:00100000:1.0:1790920514.700412:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+29:11621:x1877915951268864:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920514.700437:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920514.700460:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b07b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae2f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920514.700559:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546b082 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920514.700574:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546b082 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920514.700585:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546b082 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920514.700596:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790920514.700723:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b07b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae2f expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920514.700741:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546b082 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae2f expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920514.700776:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:1.0:1790920514.700778:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790920514.700782:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d400, rc 0) 00000100:00100000:1.0:1790920514.703864:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:11621:x1877915951268864:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 3376us (3489us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1790920514.703887:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 235 00000100:00100000:0.0:1790920514.717902:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920514.717945:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951268992 00000100:00100000:0.0:1790920514.717958:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951268992 00000100:00100000:0.0:1790920514.718012:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:0.0:1790920514.718022:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:11621:x1877915951268992:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:0.0:1790920514.718093:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718132:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718145:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718173:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718179:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718199:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718205:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920514.718906:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718918:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718932:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:0.0:1790920514.718936:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920514.718941:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920514.718948:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b090 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920514.719043:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:11621:x1877915951268992:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 1020us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920514.719063:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:0.0:1790920514.833281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920514.833407:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951269120 00000100:00100000:3.0:1790920514.833419:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951269120 00000100:00100000:3.0:1790920514.833494:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:3.0:1790920514.833505:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2353:x1877915951269120:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1790920514.833527:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920514.833551:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b097 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae36 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790920514.833581:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abf473f, atime: 0x6abf473f, ctime: 0x6abf473f, blocks: 0xb 00010000:00010000:3.0:1790920514.833600:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1790920514.833605:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920514.833615:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b097 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae36 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920514.833632:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b097 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae36 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790920514.833635:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790920514.833666:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36a00, rc 0) 00000100:00100000:3.0:1790920514.833787:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2353:x1877915951269120:12345-192.168.204.34@tcp:101:cat.0 Request processed in 243us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920514.833796:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:0.0:1790920514.839298:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920514.844632:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951269248 00000100:00100000:1.0:1790920514.844650:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951269248 00002000:00100000:1.0:1790920514.844716:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88eb3a90aa00 x1877915951269248/t0(0) o3->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:125/0 lens 488/0 e 0 to 0 dl 1790920525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920514.844728:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3a90aa00 with x1877915951269248 ext(0->4095) 00002000:00010000:1.0:1790920514.844734:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3a90aa00 00000100:00100000:1.0:1790920514.844853:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1790920514.844864:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2352:x1877915951269248:12345-192.168.204.34@tcp:3:cat.0 00000100:00100000:1.0:1790920514.845254:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2352:x1877915951269248:12345-192.168.204.34@tcp:3:cat.0 Request processed in 391us (5965us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790920514.845263:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00002000:00100000:1.0:1790920514.845270:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88eb3a90aa00 x1877915951269248/t0(0) o3->23f7dc83-f18d-4470-88f4-3dd4c845ced7@192.168.204.34@tcp:125/0 lens 488/4536 e 0 to 0 dl 1790920525 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790920514.845278:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88eb3a90aa00 with x1877915951269248 ext(0->4095) 00002000:00010000:1.0:1790920514.845282:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88eb3a90aa00 00010000:00010000:0.0:1790920515.625152:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920516.649131:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920517.682537:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920517.737040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972224896:0@lo:400:kworker.0 00000100:00100000:0.0:1790920517.737106:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920517.737171:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790920517.737177:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972224512:0@lo:400:kworker.0 00000100:00100000:0.0:1790920517.737202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920517.737221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972225024:0@lo:400:kworker.0 00000100:00100000:0.0:1790920517.737241:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920517.737262:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972224768:0@lo:400:kworker.0 00000100:00100000:0.0:1790920517.737282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920517.737296:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790920517.737300:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3443b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972224640:0@lo:400:kworker.0 00000100:00100000:0.0:1790920517.737332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920517.737346:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972225152:0@lo:400:kworker.0 00000100:00100000:0.0:1790920517.737744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920517.737811:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972224896 00000100:00100000:0.0:1790920517.737819:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972224896 00000100:00100000:0.0:1790920517.737871:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225152 00000100:00100000:0.0:1790920517.737874:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225152 00000100:00100000:0.0:1790920517.737895:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790920517.737904:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1877915972224896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920517.737979:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1877915972224896:12345-0@lo:400:kworker.0 Request processed in 75us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920517.737986:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790920517.738101:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225024 00000100:00100000:1.0:1790920517.738106:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225024 00000100:00100000:1.0:1790920517.738146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972224768 00000100:00100000:1.0:1790920517.738150:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972224768 00000100:00100000:1.0:1790920517.738163:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972224640 00000100:00100000:1.0:1790920517.738166:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972224640 00000100:00100000:1.0:1790920517.738180:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790920517.738187:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972225024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.738235:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972225024:12345-0@lo:400:kworker.0 Request processed in 48us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920517.738242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790920517.738256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790920517.738262:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972224768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.738295:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972224768:12345-0@lo:400:kworker.0 Request processed in 33us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920517.738301:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790920517.738327:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790920517.738334:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.738375:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972224640:12345-0@lo:400:kworker.0 Request processed in 41us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920517.738381:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790920517.738590:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790920517.738598:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972225152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.738698:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972225152:12345-0@lo:400:kworker.0 Request processed in 101us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920517.738704:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1790920517.738725:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790920517.738729:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920517.738732:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920517.738768:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972224512 00000100:00100000:1.0:1790920517.738772:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972224512 00000100:00100000:1.0:1790920517.738798:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1790920517.738804:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972224512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.738836:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972224512:12345-0@lo:400:kworker.0 Request processed in 32us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920517.739206:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1790920517.739262:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972224512:0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.739275:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972225024:0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.739284:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972224896:0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.739336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3443b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972224640:0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.739346:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb41f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972225152:0@lo:400:kworker.0 00000100:00100000:1.0:1790920517.739354:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972224768:0@lo:400:kworker.0 00000001:00080000:1.0:1790920517.802821:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1790920518.255382:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972225280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920518.256215:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920518.256294:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225280 00000100:00100000:1.0:1790920518.258595:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225280 00000100:00100000:1.0:1790920518.258930:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790920518.258940:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1877915972225280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790920518.258977:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920518.259059:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1877915972225280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920518.259066:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790920518.259135:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972225280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920518.285331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920518.285443:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920518.285468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920518.285500:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920518.285605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920518.285630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951269376 00000100:00100000:1.0:1790920518.285639:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951269376 00000100:00100000:1.0:1790920518.285688:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 302 00000100:00100000:1.0:1790920518.285698:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951269376:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920518.285874:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2353:x1877915951269376:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 176us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920518.285881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 302 00000100:00100000:1.0:1790920518.285915:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951269632 00000100:00100000:1.0:1790920518.285919:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951269632 00000100:00100000:1.0:1790920518.285953:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951269760 00000100:00100000:1.0:1790920518.285955:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951269760 00000100:00100000:1.0:1790920518.285979:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:1.0:1790920518.285985:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2353:x1877915951269632:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920518.286015:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+8:2353:x1877915951269632:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 30us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920518.286021:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:1.0:1790920518.286033:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:1.0:1790920518.286039:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951269760:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920518.286061:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2353:x1877915951269760:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920518.286067:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:1.0:1790920518.286085:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951269888 00000100:00100000:1.0:1790920518.286088:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951269888 00000100:00100000:1.0:1790920518.286295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951269504 00000100:00100000:1.0:1790920518.286306:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951269504 00000100:00100000:1.0:1790920518.291566:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:1.0:1790920518.291589:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951269888:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920518.291673:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2353:x1877915951269888:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 92us (6202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920518.291681:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:1.0:1790920518.291704:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:1.0:1790920518.291711:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:2353:x1877915951269504:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920518.291768:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+31:2353:x1877915951269504:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 56us (6266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920518.291775:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00080000:1.0:1790920518.291810:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790920518.291816:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920518.291819:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1790920518.319860:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1790920518.319895:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790920518.319919:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88eb05f55780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790920518.319925:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3faf0700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88eb05f559c0 00000020:00080000:3.0:1790920518.319929:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88eb3faf0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88eb3fe7ec00 00000020:00080000:3.0:1790920518.319959:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1790920518.320034:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1790920518.320271:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1790920518.347005:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1790920518.347041:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000040:00080000:0.0:1790920518.441382:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790920518.441393:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920518.441484:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790920518.441491:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790920518.697767:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920519.721039:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920519.785044:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790920519.785070:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972225408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790920519.785165:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920519.785406:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225408 00000100:00100000:1.0:1790920519.785415:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225408 00000100:00100000:1.0:1790920519.785492:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790920519.785502:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972225408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920519.785537:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920519.785599:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972225408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920519.785607:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790920519.785768:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1790920519.785774:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb34251c00, transno 4294967310 00000100:00100000:0.0:1790920519.785799:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972225408:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790920519.786216:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790920520.752139:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920521.201946:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920521.202046:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951270016 00000100:00100000:1.0:1790920521.202081:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951270016 00000100:00100000:1.0:1790920521.202170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 237 00000100:00100000:1.0:1790920521.202180:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11282:x1877915951270016:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790920521.202287:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11282:x1877915951270016:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 Request processed in 109us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920521.202295:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 237 00000100:00080000:2.0:1790920521.202717:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920521.213483:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920521.213599:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951270272 00000100:00100000:1.0:1790920521.213619:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951270272 00000100:00100000:1.0:1790920521.213684:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:1.0:1790920521.213694:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:11282:x1877915951270272:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790920521.214071:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:11282:x1877915951270272:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 364us (584us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790920521.214079:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 65 00010000:00010000:3.0:1790920521.769027:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920522.793921:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920522.869651:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790920522.869688:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972225536:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.869782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920522.870545:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225536 00000100:00100000:3.0:1790920522.870557:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225536 00000100:00100000:3.0:1790920522.870610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790920522.870619:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972225536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.870692:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972225536:12345-0@lo:400:kworker.0 Request processed in 74us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920522.870699:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790920522.870774:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972225536:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.870862:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972225664:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.870897:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920522.870933:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225664 00000100:00100000:3.0:1790920522.870937:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225664 00000100:00100000:3.0:1790920522.870965:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790920522.870971:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972225664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.871007:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972225664:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920522.871012:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790920522.872299:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972225664:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.872373:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920522.872380:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972225792:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.872424:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920522.872461:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225792 00000100:00100000:3.0:1790920522.872468:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225792 00000100:00100000:3.0:1790920522.872519:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790920522.872527:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972225792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.872570:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972225792:12345-0@lo:400:kworker.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920522.872577:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1790920522.872597:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920522.872617:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972225792:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.872664:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972225920:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.872691:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920522.872721:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972225920 00000100:00100000:3.0:1790920522.872739:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972225920 00000100:00100000:3.0:1790920522.872796:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790920522.872802:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972225920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.875587:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972225920:12345-0@lo:400:kworker.0 Request processed in 2774us (2883us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920522.875603:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1790920522.876036:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920522.876337:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1790920522.876344:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb3a908700, transno 4294967322 00000004:00080000:1.0:1790920522.876357:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1790920522.876385:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972225920:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.877443:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972226176:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.881390:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920522.883399:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920522.883429:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3433f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972226048:0@lo:400:kworker.0 00000100:00100000:1.0:1790920522.883513:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920522.883572:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226176 00000100:00100000:1.0:1790920522.883582:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226176 00000100:00100000:1.0:1790920522.883782:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790920522.883793:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972226176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920522.883864:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972226176:12345-0@lo:400:kworker.0 Request processed in 73us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920522.883886:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1790920522.883912:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920522.883949:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972226176:0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.884239:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226048 00000100:00100000:3.0:1790920522.884244:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226048 00000100:00100000:3.0:1790920522.884291:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790920522.884298:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972226048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920522.884337:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972226048:12345-0@lo:400:kworker.0 Request processed in 39us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920522.884342:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1790920522.885263:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920522.885297:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3433f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972226048:0@lo:400:kworker.0 00000100:00100000:1.0:1790920523.370249:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972226304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920523.370346:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920523.370467:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226304 00000100:00100000:1.0:1790920523.370476:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226304 00000100:00100000:1.0:1790920523.370532:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790920523.370542:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972226304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790920523.370602:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920523.370667:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972226304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920523.370674:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790920523.370734:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972226304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920523.408303:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920523.408370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920523.408406:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920523.408451:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951270400 00000100:00100000:1.0:1790920523.408469:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951270400 00000100:00100000:1.0:1790920523.408830:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 304 00000100:00100000:1.0:1790920523.408844:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951270400:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920523.408939:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951270400:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 97us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920523.408966:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 304 00000100:00100000:1.0:1790920523.409047:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920523.409153:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920523.411295:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951270656 00000100:00100000:3.0:1790920523.411310:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951270656 00000100:00100000:3.0:1790920523.411385:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951270784 00000100:00100000:3.0:1790920523.411388:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951270784 00000100:00100000:3.0:1790920523.411410:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:3.0:1790920523.411419:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951270656:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920523.411499:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2355:x1877915951270656:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 80us (3127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920523.411507:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:3.0:1790920523.411525:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:3.0:1790920523.411531:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951270784:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920523.411569:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951270784:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 38us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920523.411575:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:3.0:1790920523.411596:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951270912 00000100:00100000:3.0:1790920523.411600:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951270912 00000100:00100000:3.0:1790920523.411629:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951270528 00000100:00100000:3.0:1790920523.411632:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951270528 00000100:00100000:3.0:1790920523.411651:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:3.0:1790920523.411657:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951270912:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920523.411688:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3433f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2355:x1877915951270912:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 31us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920523.411695:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:3.0:1790920523.411706:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:3.0:1790920523.411713:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:2354:x1877915951270528:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920523.411742:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:2354:x1877915951270528:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 29us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920523.411769:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00080000:1.0:1790920523.413554:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790920523.413570:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920523.413574:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790920523.461067:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1790920523.461098:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1790920523.461123:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1790920523.461135:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:1.0:1790920523.685081:0:12681:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:55:22 (1790920522) 00010000:00010000:2.0:1790920523.818682:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920524.841104:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920524.907337:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920524.907369:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972226432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920524.907471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920524.907788:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226432 00000100:00100000:1.0:1790920524.907799:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226432 00000100:00100000:1.0:1790920524.907878:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790920524.907890:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972226432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920524.907938:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920524.908188:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972226432:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790920524.908343:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920524.908410:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972226432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 522us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920524.908419:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1790920525.866302:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920526.890598:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920527.059917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920527.061092:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951271040 00000100:00100000:3.0:1790920527.061111:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951271040 00000100:00100000:3.0:1790920527.061213:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 238 00000100:00100000:3.0:1790920527.061229:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:12286:x1877915951271040:12345-192.168.204.34@tcp:101:lsof.0 00000100:00080000:2.0:1790920527.061230:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790920527.061250:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920527.061343:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546b09e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920527.061409:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b0a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920527.061422:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920527.061433:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920527.061470:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790920527.061474:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920527.061518:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920527.061543:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36400/0x2a4915844546b09e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae3d expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920527.061562:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae3d expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920527.061570:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:3.0:1790920527.061574:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920527.061577:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37e00, rc 0) 00000100:00100000:3.0:1790920527.061674:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:12286:x1877915951271040:12345-192.168.204.34@tcp:101:lsof.0 Request processed in 450us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920527.061681:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 238 00010000:00010000:2.0:1790920527.913952:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920527.979282:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972226560:0@lo:400:kworker.0 00000100:00100000:0.0:1790920527.979377:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920527.979446:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972227072:0@lo:400:kworker.0 00000100:00100000:0.0:1790920527.979475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920527.979503:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920527.979510:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972226944:0@lo:400:kworker.0 00000100:00100000:0.0:1790920527.979535:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920527.979563:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226560 00000100:00100000:0.0:1790920527.979571:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226560 00000100:00100000:0.0:1790920527.979613:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790920527.979622:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972226560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920527.979785:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3307:x1877915972226560:12345-0@lo:400:kworker.0 Request processed in 163us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920527.979793:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790920527.979828:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227072 00000100:00100000:0.0:1790920527.979832:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227072 00000100:00100000:0.0:1790920527.979871:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790920527.979878:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972227072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920527.979910:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972227072:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920527.979916:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1790920527.979950:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920527.979978:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972226560:0@lo:400:kworker.0 00000100:00100000:0.0:1790920527.979991:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972227072:0@lo:400:kworker.0 00000100:00100000:1.0:1790920527.980080:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972226688:0@lo:400:kworker.0 00000100:00100000:1.0:1790920527.980111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920527.980140:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972227200:0@lo:400:kworker.0 00000100:00100000:1.0:1790920527.980161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920527.980193:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920527.980199:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972226816:0@lo:400:kworker.0 00000100:00100000:1.0:1790920527.980220:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920527.980609:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226688 00000100:00100000:0.0:1790920527.980614:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226688 00000100:00100000:0.0:1790920527.980647:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226816 00000100:00100000:0.0:1790920527.980651:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226816 00000100:00100000:3.0:1790920527.980855:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972226944 00000100:00100000:3.0:1790920527.980868:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972226944 00000100:00100000:3.0:1790920527.980907:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227200 00000100:00100000:3.0:1790920527.980910:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227200 00000100:00100000:3.0:1790920527.980947:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790920527.980955:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972226944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920527.981011:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972226944:12345-0@lo:400:kworker.0 Request processed in 57us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920527.981018:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790920527.981032:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790920527.981039:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972227200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920527.981071:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972227200:12345-0@lo:400:kworker.0 Request processed in 33us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920527.981077:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1790920527.981104:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790920527.981108:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920527.981131:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972227200:0@lo:400:kworker.0 00000100:00100000:3.0:1790920527.981158:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972226944:0@lo:400:kworker.0 00000100:00100000:3.0:1790920527.981667:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790920527.981676:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972226688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920527.981882:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790920527.981890:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972226816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920527.982099:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972226688:0@lo:400:kworker.0 00000100:00080000:2.0:1790920527.982122:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920527.982405:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972226688:12345-0@lo:400:kworker.0 Request processed in 729us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920527.982413:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790920527.983037:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972226816:12345-0@lo:400:kworker.0 Request processed in 1144us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920527.983046:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790920527.983360:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972226816:0@lo:400:kworker.0 00000100:00100000:2.0:1790920528.489232:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920528.489258:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972227328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920528.489341:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920528.489410:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227328 00000100:00100000:2.0:1790920528.489419:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227328 00000100:00100000:2.0:1790920528.489462:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790920528.489471:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972227328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920528.489507:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920528.489552:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972227328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920528.489559:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790920528.489581:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972227328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920528.523699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920528.523817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920528.523864:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920528.523885:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920528.523926:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920528.524003:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951271424 00000100:00100000:2.0:1790920528.524023:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951271424 00000100:00100000:2.0:1790920528.524106:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951271552 00000100:00100000:2.0:1790920528.524110:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951271552 00000100:00100000:2.0:1790920528.524139:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:2.0:1790920528.524149:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951271424:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920528.524251:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2354:x1877915951271424:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 101us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920528.524259:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:2.0:1790920528.524277:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:2.0:1790920528.524297:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951271552:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920528.524344:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2354:x1877915951271552:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 60us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920528.524352:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00080000:2.0:1790920528.524385:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790920528.524389:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920528.524731:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951271168 00000100:00100000:3.0:1790920528.524743:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951271168 00000100:00100000:3.0:1790920528.524822:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 306 00000100:00100000:3.0:1790920528.524848:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2354:x1877915951271168:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920528.524912:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2354:x1877915951271168:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 67us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920528.524930:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 306 00000100:00100000:0.0:1790920528.525275:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951271680 00000100:00100000:0.0:1790920528.525290:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951271680 00000100:00100000:0.0:1790920528.525329:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951271296 00000100:00100000:0.0:1790920528.525333:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951271296 00000100:00100000:1.0:1790920528.525886:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 179 00000100:00100000:1.0:1790920528.525898:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2354:x1877915951271680:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920528.526255:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 180 00000100:00100000:0.0:1790920528.526278:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:2354:x1877915951271296:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:2.0:1790920528.526482:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920528.527264:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:2354:x1877915951271296:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 985us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920528.527275:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 180 00000100:00100000:0.0:1790920528.533975:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2354:x1877915951271680:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 8061us (10091us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920528.533995:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 179 00000100:00100000:1.0:1790920528.619340:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920528.619792:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951271936 00000100:00100000:0.0:1790920528.619807:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951271936 00000100:00100000:0.0:1790920528.619875:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:0.0:1790920528.619885:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+18:12287:x1877915951271936:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:0.0:1790920528.621322:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:12287:x1877915951271936:12345-192.168.204.34@tcp:35:umount.0 Request processed in 1429us (1989us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1790920528.621336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:1.0:1790920528.629884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920528.630249:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951272192 00000100:00100000:0.0:1790920528.630264:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951272192 00000100:00100000:0.0:1790920528.630341:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:0.0:1790920528.630353:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+19:12287:x1877915951272192:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:0.0:1790920528.630873:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:12287:x1877915951272192:12345-192.168.204.34@tcp:35:umount.0 Request processed in 520us (1004us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1790920528.630883:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:2.0:1790920528.636343:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920528.636479:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951272448 00000100:00100000:0.0:1790920528.636493:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951272448 00000100:00100000:0.0:1790920528.636682:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:0.0:1790920528.636696:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb15bc2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+20:12287:x1877915951272448:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:0.0:1790920528.637269:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb15bc2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:12287:x1877915951272448:12345-192.168.204.34@tcp:35:umount.0 Request processed in 572us (939us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1790920528.637280:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:2.0:1790920528.640855:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920528.641016:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951272704 00000100:00100000:1.0:1790920528.641031:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951272704 00000100:00100000:1.0:1790920528.641224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:1.0:1790920528.641238:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+21:12287:x1877915951272704:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:1.0:1790920528.642733:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:12287:x1877915951272704:12345-192.168.204.34@tcp:35:umount.0 Request processed in 1488us (1883us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1790920528.642777:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:2.0:1790920528.650528:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920528.650584:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920528.650623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920528.650661:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951272960 00000100:00100000:2.0:1790920528.650668:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920528.650677:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951272960 00000100:00100000:2.0:1790920528.650704:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951273216 00000100:00100000:2.0:1790920528.650709:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951273216 00000100:00100000:0.0:1790920528.650782:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951273088 00000100:00100000:0.0:1790920528.650787:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951273088 00000100:00100000:2.0:1790920528.650792:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1790920528.650807:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+15:2355:x1877915951272960:12345-192.168.204.34@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790920528.650820:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00010000:00010000:2.0:1790920528.650828:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790920528.650831:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+15:2355:x1877915951273216:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920528.650844:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920528.650858:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030a00/0x2a4915844546a12b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9cf expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920528.650860:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139ca00/0x2a4915844546a33f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa9a expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.650897:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920528.650897:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920528.650982:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951272832 00000100:00100000:2.0:1790920528.650984:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+13:2355:x1877915951272960:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 179us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920528.650989:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951272832 00000100:00100000:3.0:1790920528.651025:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:3.0:1790920528.651032:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2351:x1877915951272832:12345-192.168.204.34@tcp:9:umount.0 00000020:00000080:3.0:1790920528.651063:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a403 00000100:00080000:3.0:1790920528.651086:0:6688:0:(import.c:65:import_set_state_nolock()) ffff88eb3a6ac800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790920528.651143:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1790920528.651485:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920528.652091:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1790920528.652122:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:2.0:1790920528.652133:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:2355:x1877915951273088:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920528.652171:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920528.652191:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421cf600/0x2a4915844546a091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda997 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.652206:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920528.652639:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:2355:x1877915951273216:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 1807us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920528.652649:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:3.0:1790920528.653022:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23f7dc83-f18d-4470-88f4-3dd4c845ced7+2:2351:x1877915951272832:12345-192.168.204.34@tcp:9:umount.0 Request processed in 1988us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920528.653035:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:3.0:1790920528.657701:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2355:x1877915951273088:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 5549us (7011us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920528.657722:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:2.0:1790920528.675675:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920528.678882:0:8267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951273600 00000100:00100000:3.0:1790920528.678901:0:8267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951273600 00000100:00100000:3.0:1790920528.679022:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:3.0:1790920528.679035:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+7:2351:x1877915951273600:12345-192.168.204.34@tcp:9:umount.0 00000020:00000080:3.0:1790920528.679080:0:8267:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a664 00000020:00010000:3.0:1790920528.679093:0:8267:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88eb3f66b800: total 0 00000100:00080000:3.0:1790920528.679099:0:8267:0:(import.c:65:import_set_state_nolock()) ffff88eb3f66a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790920528.679154:0:8267:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1790920528.679555:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:23f7dc83-f18d-4470-88f4-3dd4c845ced7+5:2351:x1877915951273600:12345-192.168.204.34@tcp:9:umount.0 Request processed in 521us (3893us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920528.679582:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00000020:00010000:2.0:1790920528.679790:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88eb3f66b800: total 0 00010000:00010000:2.0:1790920528.679835:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88eb3f66b800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1790920528.679925:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b097 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae36 expref: 4 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.679971:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546aa07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac6f expref: 3 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.680001:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88eb3f66b800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790920528.680017:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920528.680020:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920528.680021:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920528.691368:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920528.691498:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951274624 00000100:00100000:0.0:1790920528.691514:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951274624 00000100:00100000:0.0:1790920528.691739:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 239 00000100:00100000:0.0:1790920528.691799:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+22:2351:x1877915951274624:12345-192.168.204.34@tcp:39:umount.0 00000020:00000080:0.0:1790920528.691847:0:5846:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a09f 00000020:00010000:0.0:1790920528.691868:0:5846:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88eb3f978000: total 0 00000100:00080000:0.0:1790920528.691873:0:5846:0:(import.c:65:import_set_state_nolock()) ffff88eb3f97f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790920528.691905:0:5846:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1790920528.692088:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88eb3f978000: total 0 00010000:00010000:2.0:1790920528.692094:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920528.692154:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88eb3f978000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790920528.692346:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920528.692358:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920528.692372:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52a00/0x2a4915844546af78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edade9 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.692535:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920528.692540:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790920528.692570:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52400/0x2a4915844546aa77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac8b expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.692596:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:2.0:1790920528.692600:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920528.692605:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546a9c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac5a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.692626:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88eb01486600) 00010000:00010000:2.0:1790920528.692629:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920528.692633:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb029ef400/0x2a4915844546a369 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaa8 expref: 19 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.692664:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:2.0:1790920528.692667:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790920528.692671:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d600/0x2a4915844546a9f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac68 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.692694:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:2.0:1790920528.692697:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790920528.692702:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546a6c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edab96 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920528.692907:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23f7dc83-f18d-4470-88f4-3dd4c845ced7+15:2351:x1877915951274624:12345-192.168.204.34@tcp:39:umount.0 Request processed in 1108us (1549us total) trans 4294967526 rc 0/0 00010000:00010000:2.0:1790920528.693000:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88eb0856f300) 00010000:00010000:2.0:1790920528.693005:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920528.693011:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d200/0x2a4915844546a8e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac22 expref: 15 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.693030:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920528.693041:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920528.693047:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37200/0x2a4915844546b058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae21 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.693063:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88eb0856ff00) 00010000:00010000:2.0:1790920528.693065:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790920528.693068:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb00031200/0x2a4915844546a3d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaac4 expref: 13 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.693081:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:2.0:1790920528.693084:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920528.693087:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36600/0x2a4915844546aa5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edac84 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.693097:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88eb2cb2c800) 00010000:00010000:2.0:1790920528.693100:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790920528.693102:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d400/0x2a4915844546b082 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae2f expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.693120:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb01486f00) 00010000:00010000:2.0:1790920528.693122:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920528.693126:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546a385 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaaaf expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.693138:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88eb0856f400) 00010000:00010000:2.0:1790920528.693140:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790920528.693143:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3f56a600/0x2a4915844546ad56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edad5d expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920528.693169:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88eb3f978000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1790920528.693215:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920528.693218:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920528.693221:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920528.693414:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 239 00000040:00080000:2.0:1790920528.745037:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790920528.745048:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790920528.746058:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1790920528.746069:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790920528.937066:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920529.961161:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920530.031093:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920530.031123:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972227456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920530.031204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920530.031338:0:7079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227456 00000100:00100000:1.0:1790920530.031348:0:7079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227456 00000100:00100000:1.0:1790920530.031492:0:7079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790920530.031502:0:7079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972227456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790920530.031551:0:7079:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920530.031600:0:7079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972227456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920530.031607:0:7079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1790920530.031783:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920530.031822:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972227456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920530.774297:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920530.774349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920530.774393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920530.774695:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951274752 00000100:00100000:2.0:1790920530.774714:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951274752 00000100:00100000:2.0:1790920530.774838:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951275008 00000100:00100000:2.0:1790920530.774844:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951275008 00000100:00100000:1.0:1790920530.774884:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951274880 00000100:00100000:2.0:1790920530.774897:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:2.0:1790920530.774913:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+11:2354:x1877915951274752:12345-192.168.204.34@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790920530.774917:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951274880 00010000:00010000:2.0:1790920530.774936:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790920530.774984:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:1.0:1790920530.774994:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+12:2354:x1877915951275008:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920530.775008:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920530.775037:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56b600/0x2a4915844546a338 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa93 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920530.775065:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920530.775072:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029eea00/0x2a4915844546a171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9e4 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920530.775098:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920530.775155:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951275008:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 159us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920530.775165:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+10:2354:x1877915951274752:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 254us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920530.775173:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:1.0:1790920530.775202:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:1.0:1790920530.775210:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+9:2354:x1877915951274880:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920530.775218:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920530.775230:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb41e37000/0x2a4915844546a178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaa0e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920530.775242:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920530.775269:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+8:2354:x1877915951274880:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 60us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920530.775276:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:2.0:1790920530.775467:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:3.0:1790920530.815731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920530.817186:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951275264 00000100:00100000:0.0:1790920530.817283:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951275264 00000100:00100000:0.0:1790920530.817428:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 240 00000100:00100000:0.0:1790920530.817455:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+6:2351:x1877915951275264:12345-192.168.204.34@tcp:39:umount.0 00000020:00000080:0.0:1790920530.818347:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a186 00000020:00010000:0.0:1790920530.818370:0:5847:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88eb3a4ea000: total 0 00000100:00080000:3.0:1790920530.818373:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790920530.818378:0:5847:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4eb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790920530.818495:0:5847:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1790920530.818896:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b056702-0296-4eba-8ec3-f47ff1a30c26+5:2351:x1877915951275264:12345-192.168.204.34@tcp:39:umount.0 Request processed in 1443us (3179us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1790920530.818910:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 240 00000020:00010000:2.0:1790920530.827234:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88eb3a4ea000: total 0 00010000:00010000:2.0:1790920530.827354:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88eb3a4ea000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790920530.827844:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb04d19300) 00010000:00010000:2.0:1790920530.827879:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920530.827897:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b0a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae3d expref: 4 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920530.827945:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88eb3a4ea000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790920530.827961:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920530.827963:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920530.827966:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920530.846319:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920530.846509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951275520 00000100:00100000:1.0:1790920530.846524:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951275520 00000100:00100000:1.0:1790920530.846602:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 307 00000100:00100000:1.0:1790920530.846615:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+7:2351:x1877915951275520:12345-192.168.204.34@tcp:251:umount.0 00000020:00000080:1.0:1790920530.848167:0:5837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a07c 00000020:00010000:1.0:1790920530.848429:0:5837:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88eb41fd8800: total 0 00000100:00080000:1.0:1790920530.848537:0:5837:0:(import.c:65:import_set_state_nolock()) ffff88eb41fdc800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790920530.848740:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8+3:2351:x1877915951275520:12345-192.168.204.34@tcp:251:umount.0 Request processed in 2121us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920530.848790:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 307 00000020:00010000:2.0:1790920530.852879:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88eb41fd8800: total 0 00010000:00010000:2.0:1790920530.852894:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920530.852974:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88eb41fd8800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790920530.853027:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421cfc00/0x2a4915844546a132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46eda9d6 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920530.853052:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88eb41fd8800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790920530.853062:0:5834:0:(genops.c:885:class_export_put()) final put ffff88eb41fd8800/0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8 00010000:00010000:2.0:1790920530.855571:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920530.855582:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920530.855586:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790920530.868100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb41fd8800/0ac6ec8c-4c58-4c7e-bb52-3f6c6f1f6bb8 for MGS 00000020:00000080:1.0:1790920530.868197:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb41fdc800 for MGS 00010000:00010000:2.0:1790920530.984991:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920532.010582:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920533.032982:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920533.097620:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972227968:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.097719:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.097819:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790920533.097838:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972227584:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.097872:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.097902:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972228096:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.097931:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.097962:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972227712:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.097990:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.098009:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972228224:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.098084:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920533.098089:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972227840:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.098149:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227584 00000100:00100000:1.0:1790920533.098161:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227584 00000100:00100000:1.0:1790920533.098222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1790920533.098232:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972227584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098293:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3306:x1877915972227584:12345-0@lo:400:kworker.0 Request processed in 62us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.098311:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1790920533.098352:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228096 00000100:00100000:1.0:1790920533.098356:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228096 00000100:00100000:1.0:1790920533.098394:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227712 00000100:00100000:1.0:1790920533.098397:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227712 00000100:00100000:1.0:1790920533.098409:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227840 00000100:00100000:1.0:1790920533.098412:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227840 00000100:00100000:1.0:1790920533.098426:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790920533.098432:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972228096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098468:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972228096:12345-0@lo:400:kworker.0 Request processed in 35us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.098475:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790920533.098487:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790920533.098493:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972227712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098522:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972227712:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.098528:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790920533.098539:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790920533.098545:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972227840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098570:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972227840:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.098576:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790920533.098601:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972227968 00000100:00100000:1.0:1790920533.098605:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972227968 00000100:00100000:1.0:1790920533.098632:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228224 00000100:00100000:1.0:1790920533.098635:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228224 00000100:00100000:1.0:1790920533.098657:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790920533.098672:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972227968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098707:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972227968:12345-0@lo:400:kworker.0 Request processed in 36us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.098713:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790920533.098726:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790920533.098732:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972228224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098789:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972228224:12345-0@lo:400:kworker.0 Request processed in 57us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.098794:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1790920533.098821:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790920533.098839:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790920533.098842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920533.098888:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972227840:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098900:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972227712:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098909:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972228224:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098944:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972227584:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098954:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972228096:0@lo:400:kworker.0 00000100:00100000:1.0:1790920533.098963:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972227968:0@lo:400:kworker.0 00000020:01000004:1.0:1790920533.166688:0:12878:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000001:00100000:1.0:1790920533.174024:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:1.0:1790920533.174033:0:7646:0:(genops.c:885:class_export_put()) final put ffff88eb3a6af800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:3.0:1790920533.175333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a6af800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 for lustre-OST0001 00000020:00000080:3.0:1790920533.176908:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3a6ac800 for lustre-OST0001 00000020:01000004:2.0:1790920533.190336:0:12878:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790920533.190411:0:12878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.190429:0:12878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.190448:0:12878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.190476:0:12878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.190505:0:12878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790920533.190512:0:12878:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790920533.190549:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790920533.190557:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1790920533.190558:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1790920533.190565:0:12878:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1790920533.190575:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790920533.190607:0:12878:0:(import.c:65:import_set_state_nolock()) ffff88eb344bf800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1790920533.190612:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030600 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920533.190619:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.190641:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920533.190650:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920533.190657:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790920533.190659:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790920533.190663:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790920533.190719:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.190725:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920533.190856:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.190864:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00030600/0x2a4915844546a101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a108 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.190878:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.190880:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.190881:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920533.190954:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972228352:0@lo:39:umount.0 00000100:00100000:0.0:1790920533.191028:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920533.191119:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920533.191134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972228480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920533.191146:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228352 00000100:00100000:1.0:1790920533.191154:0:11700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228352 00000100:00100000:3.0:1790920533.191166:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.191203:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790920533.191212:0:11700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877915972228352:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790920533.191244:0:11700:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e8b 00000100:00080000:1.0:1790920533.191253:0:11700:0:(import.c:65:import_set_state_nolock()) ffff88eb32dc1000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790920533.191327:0:11700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1877915972228352:12345-0@lo:39:umount.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.191334:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790920533.191345:0:11700:0:(genops.c:885:class_export_put()) final put ffff88eb09ba6800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1790920533.191354:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920533.191386:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb344bf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790920533.191404:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972228352:0@lo:39:umount.0 00000020:00000080:1.0:1790920533.191428:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb09ba6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790920533.191470:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb32dc1000 for lustre-MDT0000 00000100:00080000:3.0:1790920533.191505:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790920533.191508:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790920533.191513:0:12878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790920533.192912:0:12878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.192934:0:12878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.192943:0:12878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.192962:0:12878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.192981:0:12878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920533.192988:0:12878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.192995:0:12878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.193002:0:12878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.193010:0:12878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920533.193144:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228480 00000100:00100000:2.0:1790920533.193152:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228480 00000100:00100000:2.0:1790920533.193199:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790920533.193207:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+19:3304:x1877915972228480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790920533.193232:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920533.193247:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421ce200/0x2a4915844546a108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a101 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.193262:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920533.193322:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:3304:x1877915972228480:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920533.193329:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790920533.193464:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972228480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790920533.193638:0:12878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790920533.193713:0:12878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.193722:0:12878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.193728:0:12878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920533.193734:0:12878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194038:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790920533.194046:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194054:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cf000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920533.194057:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194065:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920533.194079:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920533.194084:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790920533.194087:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1790920533.194111:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194118:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920533.194139:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194146:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421cf000/0x2a4915844546a10f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194155:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920533.194159:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194164:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920533.194167:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.194174:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920533.194180:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920533.194185:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790920533.194191:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790920533.194194:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790920533.194206:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920533.194314:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972228608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920533.194368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790920533.194425:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790920533.194429:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228608 00000100:00100000:2.0:1790920533.194435:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228608 00000100:00100000:2.0:1790920533.194479:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790920533.194486:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+18:3306:x1877915972228608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790920533.194495:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920533.194505:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421cf400/0x2a4915844546a116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a10f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.194516:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920533.194547:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:3306:x1877915972228608:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920533.194553:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790920533.194586:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3306:1877915972228608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920533.196930:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920533.196959:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.196969:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b000/0x2a4915844546a036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a03d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920533.197023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972228736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920533.197085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920533.197150:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228736 00000100:00100000:0.0:1790920533.197157:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228736 00000100:00100000:0.0:1790920533.197202:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790920533.197287:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+17:3307:x1877915972228736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920533.197302:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920533.197320:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb421ce600/0x2a4915844546a03d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a036 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.197461:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920533.197498:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3307:x1877915972228736:12345-0@lo:103:ldlm_bl.0 Request processed in 287us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920533.197506:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790920533.197545:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972228736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790920533.197765:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.197769:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.197771:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920533.197893:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920533.197896:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920533.197898:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.197956:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.197966:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139de00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920533.197971:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.197980:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920533.197988:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920533.197993:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790920533.198013:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1790920533.198040:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.198046:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920533.198076:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.198085:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.198086:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.198088:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920533.198132:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972228864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920533.198172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920533.198188:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228864 00000100:00100000:0.0:1790920533.198193:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228864 00000100:00100000:0.0:1790920533.198246:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790920533.198253:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb066b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+16:3304:x1877915972228864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920533.198262:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920533.198273:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56a800/0x2a4915844546a331 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a32a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.198283:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920533.198322:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb066b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:3304:x1877915972228864:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920533.198327:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790920533.198398:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972228864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790920533.198959:0:12878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790920533.198968:0:12878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb0139de00/0x2a4915844546a32a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a331 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920533.198981:0:12878:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790920533.201803:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920533.201841:0:12878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.201860:0:12878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.201867:0:12878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.201874:0:12878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920533.201899:0:12878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790920533.201905:0:12878:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790920533.201911:0:12878:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1790920533.201955:0:12878:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1790920533.201961:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1790920533.201967:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1790920533.201973:0:12879:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920533.201982:0:12879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.201990:0:12879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb0139d200 already unused, calling callback (ffffffffc1c7fc20) 00000020:00000080:1.0:1790920533.201990:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 10000000:00010000:2.0:1790920533.201994:0:12879:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790920533.201998:0:12878:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff88eb3f97e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790920533.202002:0:12879:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790920533.202003:0:12878:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff88eb344b8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1790920533.202011:0:12879:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790920533.202012:0:12878:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff88eb3a4ea000 2b056702-0296-4eba-8ec3-f47ff1a30c26 192.168.204.34@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790920533.202017:0:12878:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff88eb3f978000 23f7dc83-f18d-4470-88f4-3dd4c845ced7 192.168.204.34@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 10000000:01000000:2.0:1790920533.202022:0:12879:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:1.0:1790920533.202023:0:12878:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff88eb344b3380) has exports, disconnecting them 10000000:01000000:2.0:1790920533.202025:0:12879:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790920533.202027:0:12879:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:1.0:1790920533.202028:0:12878:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88eb3f97e000), last request at 1790920533 00000020:00000080:1.0:1790920533.202036:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469ffe 00000100:00080000:1.0:1790920533.202056:0:12878:0:(import.c:65:import_set_state_nolock()) ffff88eb3f979800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790920533.202070:0:12879:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.202077:0:12879:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790920533.202108:0:12879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920533.202165:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb0139d200/0x2a49158445469dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a49158445469df1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920533.202201:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972228992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920533.202292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790920533.202366:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920533.202368:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920533.202413:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972228992 00000100:00100000:0.0:1790920533.202422:0:8460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972228992 00000100:00100000:0.0:1790920533.202478:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790920533.202488:0:8460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+15:3305:x1877915972228992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920533.202505:0:8460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920533.202525:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029eec00/0x2a49158445469df1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a49158445469dea expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920533.202542:0:8460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920533.202584:0:8460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c919bef2-7b4c-43c9-b63e-1d62f5af2ace+14:3305:x1877915972228992:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920533.202591:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790920533.202631:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3305:1877915972228992:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790920533.202649:0:12878:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88eb3f97e000): rc 0 00000020:00000080:1.0:1790920533.202652:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb3f97e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1790920533.202664:0:12878:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88eb344b8000), last request at 1790920533 00000020:00000080:1.0:1790920533.202668:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469f33 00000100:00080000:1.0:1790920533.202674:0:12878:0:(import.c:65:import_set_state_nolock()) ffff88eb344b9000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790920533.206990:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920533.208900:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790920533.210154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f97e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1790920533.210667:0:12878:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88eb344b8000): rc 0 00000020:00000080:1.0:1790920533.210672:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb344b8000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1790920533.210690:0:12878:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaea8014f7ae0 00000100:00080000:1.0:1790920533.210733:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790920533.210738:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1790920533.210766:0:12878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790920533.210853:0:12878:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790920533.210879:0:12878:0:(import.c:65:import_set_state_nolock()) ffff88eb3f49f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790920533.210903:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790920533.210906:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1790920533.210915:0:12878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790920533.210951:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972229120:0@lo:9:umount.0 00000100:00080000:1.0:1790920533.210976:0:12878:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790920533.210984:0:12878:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4fd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790920533.211020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.211047:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972229120 00000100:00100000:1.0:1790920533.211055:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972229120 00000100:00100000:0.0:1790920533.211064:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972229248:0@lo:9:umount.0 00000100:00100000:0.0:1790920533.211084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920533.211099:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972229248 00000100:00100000:1.0:1790920533.211102:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972229248 00000100:00100000:1.0:1790920533.211122:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790920533.211131:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877915972229120:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790920533.211156:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469f80 00000100:00080000:1.0:1790920533.211165:0:6690:0:(import.c:65:import_set_state_nolock()) ffff88eb3f9ac800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1790920533.211176:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f979800 for lustre-MDT0000 00000020:00000080:2.0:1790920533.211181:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344b8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790920533.211209:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb344b9000 for lustre-MDT0000 00010000:00010000:3.0:1790920533.211613:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920533.211820:0:8267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790920533.211840:0:8267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877915972229248:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790920533.211856:0:8267:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a067 00000100:00080000:0.0:1790920533.211862:0:8267:0:(import.c:65:import_set_state_nolock()) ffff88eb3f49a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790920533.211900:0:8267:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790920533.212306:0:8267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1877915972229248:12345-0@lo:9:umount.0 Request processed in 467us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920533.212314:0:8267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:00080000:0.0:1790920533.212355:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff88eb344b3380) has no exports 00000100:00080000:2.0:1790920533.213010:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3a4fd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790920533.213024:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790920533.213026:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790920533.213030:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972229248:0@lo:9:umount.0 00010000:00010000:3.0:1790920533.213139:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1790920533.214821:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790920533.215077:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3303:x1877915972229120:12345-0@lo:9:umount.0 Request processed in 3942us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920533.215088:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790920533.215162:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f49f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790920533.215173:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790920533.215175:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790920533.215179:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972229120:0@lo:9:umount.0 00010000:00010000:3.0:1790920533.217835:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790920533.228960:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff88eb344b3380) has no exports 00000020:00000080:1.0:1790920533.277725:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e45 00000020:00000080:1.0:1790920533.277835:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb3b992800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790920533.277914:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1790920533.277998:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3b992800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790920533.278055:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790920533.278066:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790920533.278071:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff88eb3b9d4d40) has no exports 00000020:00000080:0.0:1790920533.278627:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e3e 00000020:00000080:0.0:1790920533.278635:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb32dc5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790920533.278788:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb32dc5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790920533.283440:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790920533.283457:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790920533.283463:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb32dc2000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790920533.283467:0:12878:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb32dc2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790920533.283478:0:12878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:1.0:1790920533.675556:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790920533.675567:0:6712:0:(genops.c:885:class_export_put()) final put ffff88eb3f9ae800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790920533.675597:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:1.0:1790920533.675601:0:6712:0:(genops.c:885:class_export_put()) final put ffff88eb3f66b800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:1.0:1790920533.675617:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f9ae800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790920533.675658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f66b800/23f7dc83-f18d-4470-88f4-3dd4c845ced7 for lustre-OST0000 00000020:00000080:1.0:1790920533.675686:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f9ac800 for lustre-OST0000 00000020:00000080:1.0:1790920533.676034:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f66a800 for lustre-OST0000 00000001:00100000:2.0:1790920533.681061:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b056702-0296-4eba-8ec3-f47ff1a30c26 00000001:00080000:2.0:1790920533.681078:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1790920533.681097:0:5868:0:(genops.c:885:class_export_put()) final put ffff88eb3a4ea000/2b056702-0296-4eba-8ec3-f47ff1a30c26 00000001:00100000:2.0:1790920533.681122:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000001:00080000:2.0:1790920533.681129:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1790920533.681143:0:5868:0:(genops.c:885:class_export_put()) final put ffff88eb3f978000/23f7dc83-f18d-4470-88f4-3dd4c845ced7 00000020:00000080:3.0:1790920533.681302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a4ea000/2b056702-0296-4eba-8ec3-f47ff1a30c26 for lustre-MDT0000 00000020:00000080:3.0:1790920533.681356:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f978000/23f7dc83-f18d-4470-88f4-3dd4c845ced7 for lustre-MDT0000 00000020:00000080:3.0:1790920533.681391:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3a4eb000 for lustre-MDT0000 00000020:00000080:3.0:1790920533.681396:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f97f000 for lustre-MDT0000 00010000:00010000:3.0:1790920534.056996:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920535.084353:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790920535.337209:0:12878:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88ea02993960 - data ffff88eb3fc4dbd0/ffff88ea01f8c800 00000020:01000000:0.0:1790920535.337341:0:12878:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88eb06701a20 - data ffff88eb2c670870/ffff88eb33ef0400 00000001:00000004:0.0:1790920535.348948:0:12878:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1790920535.507238:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790920535.507247:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1790920535.507270:0:12878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790920535.507272:0:12878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790920535.507684:0:7077:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790920535.507689:0:7077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1790920535.507698:0:7077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790920535.508689:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790920535.508695:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1790920535.508724:0:12878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790920535.508726:0:12878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790920535.509481:0:7927:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790920535.509487:0:7927:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790920535.509497:0:7927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1790920535.581258:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e0d 00000020:00000080:1.0:1790920535.581286:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb344b8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790920535.582405:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e22 00000020:00000080:1.0:1790920535.582414:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb344ba800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790920535.582421:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1790920535.582427:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790920535.582436:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790920535.582440:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff88eb344b4d40) has no exports 00000004:01000000:1.0:1790920535.582588:0:12878:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790920535.582598:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a060 00000020:00000080:1.0:1790920535.582603:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb3f499000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790920535.582607:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790920535.582611:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790920535.582618:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790920535.582620:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff88eb41c03380) has no exports 00000020:00000080:1.0:1790920535.582627:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a4915844546a059 00000020:00000080:1.0:1790920535.582630:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb3a4fe000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1790920535.583012:0:12878:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790920535.583017:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790920535.583022:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1790920535.583028:0:12878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790920535.583030:0:12878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790920535.583062:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920535.583069:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790920535.583077:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469f79 00000020:00000080:1.0:1790920535.583082:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb3f49d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790920535.583085:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790920535.583088:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790920535.583091:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790920535.583094:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff88eb41c00000) has no exports 00000020:00000080:1.0:1790920535.583098:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469f72 00000020:00000080:1.0:1790920535.583100:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb3f49c800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1790920535.583443:0:12878:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790920535.583454:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790920535.583456:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1790920535.583459:0:12878:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790920535.583460:0:12878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790920535.583483:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920535.583487:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790920535.583507:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920535.583510:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790920535.583532:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e29 00000020:00000080:1.0:1790920535.583537:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb344bb800/lustre-MDD0000_UUID 00000020:01000000:1.0:1790920535.583541:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790920535.583543:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790920535.583547:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790920535.583549:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff88eb344b19c0) has no exports 00000020:00000080:1.0:1790920535.583570:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920535.583573:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790920535.583575:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e30 00000020:00000080:1.0:1790920535.583577:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb344be800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790920535.583584:0:12878:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb09ba1000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790920535.583587:0:12878:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb09ba1000 3 00000020:01000004:1.0:1790920535.583590:0:12878:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88eb09ba1000 from lustre-MDT0000 00000020:00000080:1.0:1790920535.583604:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920535.583606:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790920535.583608:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb344be000/lustre-MDT0000_UUID 00000020:00000080:1.0:1790920535.583611:0:12878:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344be000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790920535.583618:0:12878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790920535.583675:0:12878:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1790920535.583678:0:12878:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790920535.583681:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790920535.583683:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790920535.583686:0:12878:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790920535.583692:0:12878:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff88eb058a9000 c919bef2-7b4c-43c9-b63e-1d62f5af2ace 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790920535.583697:0:12878:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff88eb05f119c0) has exports, disconnecting them 00000020:00080000:1.0:1790920535.583706:0:12878:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff88eb058a9000), last request at 1790920296 00000020:00000080:1.0:1790920535.583720:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469dce 00000020:00010000:1.0:1790920535.583725:0:12878:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88eb058a9000: total 8 00000100:00080000:1.0:1790920535.583730:0:12878:0:(import.c:65:import_set_state_nolock()) ffff88eb058ad000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790920535.583771:0:12878:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88eb058a9000): rc 0 00000020:00080000:1.0:1790920535.583775:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff88eb05f119c0) has no exports 00000100:00100000:1.0:1790920535.583878:0:5837:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff88eb058cf400:5837] 0 exiting: rc = 1 00000100:00100000:1.0:1790920535.583950:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff88eb058cf800:5839] 1 exiting: rc = 0 00000020:00010000:3.0:1790920535.584105:0:12879:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88eb058a9000: total 8 00010000:00010000:3.0:1790920535.584143:0:12879:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88eb058a9000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1790920535.584173:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029eee00/0x2a4915844546a0de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a0d7 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584198:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb029efa00/0x2a4915844546a0ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a0e5 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584212:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139c800/0x2a4915844546a315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a30e expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584223:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030200/0x2a4915844546a0fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a0f3 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584233:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb0139ce00/0x2a49158445469ee6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a49158445469edf expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584247:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00030800/0x2a4915844546a124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a11d expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584256:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56aa00/0x2a4915844546a323 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a31c expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584268:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb00031a00/0x2a4915844546a0d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2a4915844546a0c9 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920535.584277:0:12879:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88eb058a9000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1790920535.584291:0:12879:0:(genops.c:885:class_export_put()) final put ffff88eb058a9000/c919bef2-7b4c-43c9-b63e-1d62f5af2ace 00010000:00010000:3.0:1790920535.584297:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920535.584299:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920535.584300:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790920535.584546:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344b8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790920535.584559:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344ba800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1790920535.584569:0:37:0:(genops.c:885:class_export_put()) final put ffff88eb08491800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790920535.584571:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb08491800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790920535.584576:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790920535.584693:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f499000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790920535.584697:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a4fe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790920535.584701:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3a4fd000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790920535.584705:0:37:0:(genops.c:885:class_export_put()) final put ffff88eb3a4fa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790920535.584706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a4fa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790920535.584709:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790920535.584729:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f49d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790920535.584733:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f49c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790920535.584736:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f49f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790920535.584766:0:37:0:(genops.c:885:class_export_put()) final put ffff88eb3f498000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790920535.584768:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f498000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790920535.584771:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790920535.584832:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344bb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790920535.584835:0:37:0:(genops.c:885:class_export_put()) final put ffff88eb344ba000/lustre-MDD0000_UUID 00000020:00000080:0.0:1790920535.584836:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344ba000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790920535.584839:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790920535.584946:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344be800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790920535.584950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb058a9000/c919bef2-7b4c-43c9-b63e-1d62f5af2ace for MGS 00000020:00000080:0.0:1790920535.584980:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb058ad000 for MGS 00000100:00100000:1.0:1790920535.586707:0:5840:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff88eb03858200:5840] 2 exiting: rc = 0 00000100:00100000:0.0:1790920535.586855:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586863:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586869:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586874:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586880:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586885:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586901:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586905:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586910:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586916:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586921:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586926:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586931:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586936:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586941:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586948:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586954:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586961:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586966:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586972:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586977:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586982:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586987:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586993:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.586998:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587004:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587010:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587015:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587021:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587027:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587032:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587037:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587043:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587049:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587054:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587059:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587065:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587069:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587073:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587078:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587083:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587096:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587101:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587107:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587112:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587117:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587122:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587127:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587133:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587138:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587144:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587150:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587155:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587160:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587166:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587171:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587177:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587182:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587188:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587193:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587199:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587205:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587211:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.587217:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790920535.587576:0:12878:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790920535.587579:0:12878:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1790920535.588061:0:12878:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88eb05032600 - data ffff88ea01646a20/ffff88ea029b2c00 00000020:01000000:0.0:1790920535.588183:0:12878:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88eb0662af60 - data ffff88eb30770948/ffff88eb09b11800 00000020:00000080:0.0:1790920535.588920:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469db2 00000020:00000080:0.0:1790920535.588928:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb0563d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790920535.588948:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb0563d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1790920535.588961:0:12878:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb09ba1000 from MGS, refs=2 00000020:01000004:0.0:1790920535.588964:0:12878:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb09ba1000 2 00000020:01000004:0.0:1790920535.588967:0:12878:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88eb09ba1000 from MGS 00000020:00000080:0.0:1790920535.588986:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790920535.589002:0:12878:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790920535.589005:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb0676d000/MGS 00000020:00000080:0.0:1790920535.589007:0:12878:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb0676d000/MGS for MGS 00000020:01000000:0.0:1790920535.589014:0:12878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790920535.589067:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790920535.589071:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790920535.589076:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790920535.589081:0:12878:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88eb344bd000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790920535.589086:0:12878:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff88eb344b0000) has exports, disconnecting them 00000020:00080000:0.0:1790920535.589091:0:12878:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88eb344bd000), last request at 1790920297 00000020:00000080:0.0:1790920535.589095:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469e7d 00000020:00080000:0.0:1790920535.589103:0:12878:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88eb344bd000): rc 0 00000020:00000080:0.0:1790920535.589107:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb344bd000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790920535.589131:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344bd000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790920535.590991:0:12878:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790920535.590999:0:12878:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790920535.591003:0:12878:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790920535.591009:0:12878:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790920535.591194:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920535.591201:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790920535.591207:0:12878:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb09ba1000 1 00000020:00000080:1.0:1790920535.591214:0:12878:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469da4 00000020:00000080:1.0:1790920535.591222:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb06769000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790920535.591226:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790920535.591232:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790920535.591235:0:12878:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790920535.591238:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff88eb05f13380) has no exports 00000020:00000080:3.0:1790920535.591302:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb344bf800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790920535.591309:0:8:0:(genops.c:885:class_export_put()) final put ffff88eb344bb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790920535.591311:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb344bb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790920535.591329:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790920535.591386:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb06769000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790920535.632685:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790920535.632700:0:12878:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790920535.632706:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb067db800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790920535.632711:0:12878:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb067db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790920535.632723:0:12878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790920535.632890:0:12878:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88eb09ba0800 00000020:01000000:3.0:1790920535.632912:0:12878:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1790920535.632916:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790920535.632920:0:12878:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790920535.632924:0:12878:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff88eb05f14d40) has no exports 00000100:00100000:0.0:1790920535.635880:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff88eb0db46000:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1790920535.638322:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff88eb057e9000:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1790920535.638415:0:5847:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff88eb0e951000:5847] 2 exiting: rc = 0 00000100:00100000:1.0:1790920535.638468:0:11700:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff88eb071b6e00:11700] 3 exiting: rc = 0 00000100:00100000:3.0:1790920535.638889:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638901:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638906:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638910:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638916:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638920:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638925:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638930:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638935:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638940:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638945:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638950:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638956:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638961:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638966:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638972:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638978:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638984:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638989:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.638995:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639001:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639024:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639029:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639034:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639040:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639045:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639051:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639059:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639065:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639069:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639075:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639080:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639089:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639095:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639103:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639111:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639118:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639125:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639133:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639141:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639146:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639157:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639170:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639176:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639181:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639186:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639191:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639197:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639203:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639209:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639215:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639220:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639225:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639230:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639235:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639240:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639253:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639258:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639264:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639269:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639274:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639279:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639285:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.639291:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.647455:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88eb10ab0a00:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1790920535.647806:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88eb10ab1a00:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1790920535.647959:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.647966:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.647973:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.647978:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.647986:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648004:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648010:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648015:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648022:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648027:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648032:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648037:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648043:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648047:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648054:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648059:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648065:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648069:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648075:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648080:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648086:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648092:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648098:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648103:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648108:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648112:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648117:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648121:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648126:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648131:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648135:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648139:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648144:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648149:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648154:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648158:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648162:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648167:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648171:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648176:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648190:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648195:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648200:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648205:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648210:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648215:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648220:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648225:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648230:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648235:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648240:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648245:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648251:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648256:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648262:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648267:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648273:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648277:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648282:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648286:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648291:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648296:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648301:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.648305:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.649618:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff88eb10a41c00:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1790920535.649982:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff88eb10a41200:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1790920535.651184:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651195:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651206:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651213:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651219:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651225:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651232:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651238:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651245:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651252:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651259:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651265:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651271:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651277:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651282:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651304:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651313:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651319:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651325:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651331:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651349:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651358:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651368:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651374:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.651379:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653601:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653631:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653681:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653689:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653695:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653701:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653708:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653714:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653720:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653726:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653734:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653740:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653758:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653766:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653797:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653804:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653810:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653816:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653823:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653833:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653841:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653847:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653853:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653860:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653866:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653874:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653893:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653901:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653908:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653915:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653922:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653928:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653935:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653942:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653948:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653955:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653961:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653978:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.653985:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920535.667253:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88eb10a41e00:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1790920535.667349:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88eb10a40800:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1790920535.667512:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667519:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667524:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667528:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667533:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667537:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667542:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667546:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667551:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667556:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667560:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667564:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667569:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667575:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667579:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667583:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667604:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667609:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667613:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667617:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667622:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667626:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667631:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667635:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667639:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667643:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667659:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667666:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667671:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667675:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667717:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667723:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667728:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667745:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667766:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667770:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667783:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667789:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667793:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667797:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667802:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667806:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667810:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667815:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667819:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667823:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667827:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667831:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667835:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667844:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667848:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667852:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667856:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667861:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667865:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667869:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667874:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667878:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667882:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667886:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667890:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667895:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667899:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.667903:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790920535.668855:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88eb10ab1800:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1790920535.668872:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88eb10ab1400:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1790920535.669160:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669167:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669173:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669179:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669195:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669200:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669205:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669210:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669215:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669220:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669225:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669230:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669236:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669241:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669246:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669251:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669256:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669261:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669266:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669271:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669276:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669281:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669286:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669290:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669295:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669299:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669304:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669308:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669312:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669317:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669321:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669326:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669339:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669344:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669351:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669356:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669360:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669365:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669370:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669381:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669452:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669459:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669464:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669469:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669474:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669479:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669484:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669488:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669493:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669498:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669503:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669507:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669512:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669517:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669521:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669526:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669534:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669539:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669543:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669548:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669552:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669557:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669561:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669567:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.669931:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff88eb10ab1000:5856] 0 exiting: rc = 1 00000100:00100000:0.0:1790920535.670367:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff88eb10ab0e00:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1790920535.670576:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670583:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670588:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670593:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670598:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670603:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670607:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670612:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670618:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670631:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670638:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670654:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670661:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670672:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670678:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670683:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670694:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670699:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670704:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670714:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670723:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670729:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670734:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670743:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670767:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670773:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670791:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670798:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670804:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670810:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670815:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670825:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670836:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670842:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670847:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670857:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670866:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670871:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670876:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670886:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670896:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670901:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670907:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670917:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670934:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670939:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670950:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670955:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670963:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670968:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670974:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670979:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670988:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.670995:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671004:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671009:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671015:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671609:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671619:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671625:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671631:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671638:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671645:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.671652:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920535.672213:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff88eb0b5ade00:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1790920535.672459:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff88eb08eda600:5860] 2 exiting: rc = 0 00000100:00100000:2.0:1790920535.680806:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff88eb33b29800:5859] 1 exiting: rc = 0 00000100:00100000:3.0:1790920535.700890:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700902:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700909:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700915:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700922:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700928:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700933:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700939:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700946:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700953:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700958:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.700964:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701010:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701018:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701025:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701045:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701052:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701059:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701065:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701072:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701079:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701085:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701092:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701098:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701104:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701111:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701118:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701123:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701130:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701136:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701143:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701149:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701156:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701163:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701171:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701177:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701198:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701205:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701211:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701217:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701222:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701227:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701234:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701241:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701247:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701253:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701258:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701264:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701270:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701276:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701288:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701294:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701300:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701306:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701312:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701317:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701324:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701331:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701349:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701356:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701362:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701368:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701374:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790920535.701380:0:12878:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790920535.706321:0:12878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790920535.706335:0:12878:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1790920535.706340:0:12878:0:(genops.c:885:class_export_put()) final put ffff88eb0563b800/MDS_uuid 00000020:00000080:3.0:1790920535.706344:0:12878:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb0563b800/MDS_uuid for MDS 00000020:01000000:3.0:1790920535.706355:0:12878:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1790920535.706494:0:12878:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1790920536.105541:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920537.133145:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920538.155491:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920538.233244:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790920538.233267:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972229376:0@lo:400:kworker.0 00000400:00000100:3.0:1790920538.233332:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877915972229376 offset 0 length 224: 4 00000100:00100000:3.0:1790920538.233647:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972229504:0@lo:400:kworker.0 00000400:00000100:3.0:1790920538.233668:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972229504 offset 0 length 224: 4 00000100:00100000:3.0:1790920538.233703:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790920538.233709:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972229632:0@lo:400:kworker.0 00000400:00000100:3.0:1790920538.233725:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972229632 offset 0 length 224: 4 00000001:00100000:3.0:1790920538.309645:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790920538.309655:0:7646:0:(genops.c:885:class_export_put()) final put ffff88eb3f49b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790920538.309680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f49b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790920538.309719:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f49a800 for lustre-OST0001 00010000:00010000:3.0:1790920539.180604:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790920539.721338:0:13031:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790920539.746574:0:13031:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790920539.746630:0:13031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920539.746646:0:13031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920539.746654:0:13031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920539.746660:0:13031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920539.746714:0:13031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790920539.746721:0:13031:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790920539.746744:0:13031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790920539.746790:0:13031:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb33f71880 x1877915972229504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920554 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920539.746806:0:13031:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790920539.746834:0:13031:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790920539.746859:0:13031:0:(import.c:65:import_set_state_nolock()) ffff88eb3f9aa800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1790920539.746936:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920539.746945:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920539.746954:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cea00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920539.746958:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920539.746974:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920539.746981:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920539.746988:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790920539.746990:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790920539.746993:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790920539.747022:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920539.747028:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920539.747057:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920539.747065:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421cea00/0x2a4915844546a0e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2a4915844546a0ec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920539.747077:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920539.747079:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920539.747080:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920539.747096:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1877915972229760:0@lo:39:umount.0 00000400:00000100:1.0:1790920539.747148:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972229760 offset 0 length 224: 4 00000100:00100000:1.0:1790920539.747224:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790920539.747232:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972229888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920539.747265:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920539.747300:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972229888 00000100:00100000:1.0:1790920539.747312:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972229888 00000100:00100000:1.0:1790920539.747366:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790920539.747373:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1877915972229888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790920539.747379:0:5830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790920539 with bad export cookie 3046990280734973390 00000100:00100000:0.0:1790920539.749422:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972229504:0@lo:400:kworker.0 00000100:00100000:0.0:1790920539.768580:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1877915972229888:12345-0@lo:103:ldlm_bl.0 Request processed in 21195us (21302us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790920539.768600:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790920539.770429:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790920539.770439:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88eb0563d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790920539.770444:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1790920539.780123:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.134@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790920539.780129:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790920539.780140:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb33f70a80 x1877915972229376/t0(0) o400->MGC192.168.204.134@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790920554 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920539.780571:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb3f654380 x1877915972229888/t0(0) o103->MGC192.168.204.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790920555 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790920539.780583:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790920539.780586:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790920539.780588:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790920539.780594:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88eb0563d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790920539.780599:0:3304:0:(import.c:545:import_select_connection()) MGC192.168.204.134@tcp: connect to NID 0@lo last attempt 138 00000100:00080000:1.0:1790920539.780614:0:3304:0:(import.c:666:import_select_connection()) MGC192.168.204.134@tcp: import ffff88eb0563d800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1790920539.784387:0:3304:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f571880 x1877915972230016/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790920539.784438:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3304:1877915972229888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920539.784629:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3303:1877915972230016:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1790920539.784685:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877915972230016 offset 0 length 520: 4 00000100:00100000:0.0:1790920539.786657:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3307:1877915972229376:0@lo:400:kworker.0 00010000:00010000:3.0:1790920540.200980:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920541.225166:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920542.252104:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920543.274041:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920543.337692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790920543.337702:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790920543.337935:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972230144:0@lo:400:kworker.0 00000400:00000100:2.0:1790920543.337995:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972230144 offset 0 length 224: 4 00010000:00010000:3.0:1790920544.297154:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920544.360909:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790920544.360919:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790920544.361300:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790920544.361326:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972230272:0@lo:400:kworker.0 00000400:00000100:2.0:1790920544.361386:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972230272 offset 0 length 224: 4 00010000:00010000:1.0:1790920545.321079:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920546.347726:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920547.369351:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920548.393045:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920549.417080:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920549.480876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790920549.480888:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790920549.481161:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790920549.481176:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972230400:0@lo:400:kworker.0 00000400:00000100:0.0:1790920549.481233:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972230400 offset 0 length 224: 4 00000100:00100000:1.0:1790920549.999306:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790920539/real 1790920539] req@ffff88eb3f571880 x1877915972230016/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790920549 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920549.999341:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88eb3f571880 x1877915972230016/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790920549 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920549.999353:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790920539/real 1790920539] req@ffff88eb4189ea00 x1877915972229760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790920549 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920549.999366:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88eb4189ea00 x1877915972229760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790920549 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790920549.999384:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb0563d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790920549.999413:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1790920549.999417:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3303:1877915972230016:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1790920549.999423:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f9aa800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790920549.999442:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1877915972229760:0@lo:39:umount.0 00000100:00080000:3.0:1790920549.999543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790920549.999549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790920549.999552:0:37:0:(import.c:65:import_set_state_nolock()) ffff88eb0563d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790920549.999557:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.134@tcp: connect to NID 0@lo last attempt 381 00000100:00080000:3.0:1790920549.999562:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.134@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790920549.999564:0:13031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790920549.999569:0:13031:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00080000:3.0:1790920549.999572:0:37:0:(import.c:666:import_select_connection()) MGC192.168.204.134@tcp: import ffff88eb0563d800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1790920549.999573:0:13031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1790920549.999606:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb33f70000 x1877915972230528/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790920549.999683:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920549.999694:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972230656:0@lo:400:kworker.0 00000400:00000100:3.0:1790920549.999771:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972230656 offset 0 length 224: 4 00000100:00100000:1.0:1790920550.000599:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3303:1877915972230528:0@lo:250:kworker.0 00000400:00000100:1.0:1790920550.000630:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877915972230528 offset 0 length 520: 4 00010000:00010000:0.0:1790920550.001184:0:13031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001198:0:13031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001206:0:13031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001225:0:13031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001255:0:13031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920550.001264:0:13031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001271:0:13031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001277:0:13031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001283:0:13031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920550.001302:0:13031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790920550.001307:0:13031:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1790920550.001326:0:13031:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1790920550.001330:0:13031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1790920550.001335:0:13031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790920550.001341:0:13031:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790920550.001345:0:13031:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff88eb3b9d19c0) has no exports 00000020:00080000:0.0:1790920550.001369:0:13031:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff88eb3b9d19c0) has no exports 00010000:00010000:3.0:1790920550.001564:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790920550.001572:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001580:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb421cf800 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:3.0:1790920550.001591:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001600:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790920550.001607:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920550.001613:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790920550.001615:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1790920550.001617:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1790920550.001629:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88eb0563d800 00010000:00010000:3.0:1790920550.001632:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001638:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421cf800/0x2a4915844546a0f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a0fa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001651:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920550.001654:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001659:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37a00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:3.0:1790920550.001661:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001666:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790920550.001672:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920550.001683:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790920550.001684:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790920550.001686:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790920550.001799:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88eb0563d800 00010000:00010000:3.0:1790920550.001804:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001809:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb41e37a00/0x2a4915844546a31c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a323 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920550.001819:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920550.001820:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920550.001822:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920550.002287:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790920550.009232:0:13031:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88eb051e9f60 - data ffff88eb2c664af8/ffff88eb06753400 00000020:01000000:0.0:1790920550.009363:0:13031:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88eb34257e40 - data ffff88eb30701948/ffff88eb3fa98800 00100000:10000000:0.0:1790920550.017672:0:13031:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790920550.045469:0:13031:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469f02 00000020:00000080:2.0:1790920550.045483:0:13031:0:(genops.c:885:class_export_put()) final put ffff88eb3f499800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790920550.045507:0:13031:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb05888000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790920550.045511:0:13031:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb05888000 2 00000020:01000004:2.0:1790920550.045515:0:13031:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88eb05888000 from lustre-OST0000 00000020:00000080:2.0:1790920550.045540:0:13031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790920550.045552:0:13031:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790920550.045554:0:13031:0:(genops.c:885:class_export_put()) final put ffff88eb3f49e800/lustre-OST0000_UUID 00000020:00000080:2.0:1790920550.045557:0:13031:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f49e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790920550.045566:0:13031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790920550.045615:0:13031:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790920550.045630:0:13031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790920550.045634:0:13031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790920550.045640:0:13031:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790920550.045646:0:13031:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88eb3f97d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790920550.045653:0:13031:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff88eb3b9d0000) has exports, disconnecting them 00000020:00080000:2.0:1790920550.045658:0:13031:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88eb3f97d000), last request at 1790920315 00000020:00000080:2.0:1790920550.045662:0:13031:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469f2c 00000020:00080000:2.0:1790920550.045676:0:13031:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88eb3f97d000): rc 0 00000020:00000080:2.0:1790920550.045681:0:13031:0:(genops.c:885:class_export_put()) final put ffff88eb3f97d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790920550.045958:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f499800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790920550.045971:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f97d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790920550.046847:0:13031:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790920550.046853:0:13031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790920550.046857:0:13031:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790920550.046863:0:13031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790920550.047010:0:13031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790920550.047016:0:13031:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1790920550.047023:0:13031:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb05888000 1 00000020:00000080:3.0:1790920550.047029:0:13031:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469ebc 00000020:00000080:3.0:1790920550.047035:0:13031:0:(genops.c:885:class_export_put()) final put ffff88eb05927000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1790920550.047039:0:13031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1790920550.047056:0:13031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790920550.047059:0:13031:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790920550.047062:0:13031:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff88eb06664d40) has no exports 00000020:00000080:1.0:1790920550.047658:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f9aa800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790920550.047667:0:37:0:(genops.c:885:class_export_put()) final put ffff88eb3b996000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790920550.047670:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3b996000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790920550.047688:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790920550.047774:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb05927000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790920550.073583:0:13031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790920550.073614:0:13031:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790920550.073620:0:13031:0:(genops.c:885:class_export_put()) final put ffff88eb0588e000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790920550.073624:0:13031:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb0588e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790920550.073635:0:13031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790920550.073824:0:13031:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88eb05889800 00000020:02000400:3.0:1790920550.073872:0:13031:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790920550.441170:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920551.464988:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920552.488932:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790920552.929071:0:13184:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790920552.947961:0:13184:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790920552.948038:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920552.948055:0:13184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920552.948064:0:13184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920552.948071:0:13184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920552.948099:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790920552.948106:0:13184:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790920552.948132:0:13184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790920552.948148:0:13184:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb33f72a00 x1877915972229632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920554 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920552.948168:0:13184:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb3f655180 x1877915972230144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920559 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920552.948181:0:13184:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb3f656680 x1877915972230272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920552.948211:0:13184:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb3f654380 x1877915972230400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920552.948218:0:13184:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb33f73800 x1877915972230656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920552.948231:0:13184:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790920552.948238:0:13184:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790920552.948264:0:13184:0:(import.c:65:import_set_state_nolock()) ffff88eb3f97a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790920552.950431:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972230400:0@lo:400:kworker.0 00000100:00100000:2.0:1790920552.950458:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972229632:0@lo:400:kworker.0 00000100:00100000:2.0:1790920552.950501:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972230272:0@lo:400:kworker.0 00000100:00100000:2.0:1790920552.950508:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972230144:0@lo:400:kworker.0 00010000:00010000:0.0:1790920552.950683:0:12879:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920552.950694:0:12879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920552.950704:0:12879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb029ee400 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920552.950708:0:12879:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920552.950718:0:12879:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920552.950725:0:12879:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920552.950730:0:12879:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790920552.950733:0:12879:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790920552.950735:0:12879:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790920552.950781:0:12879:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88eb0563d800 00010000:00010000:0.0:1790920552.950785:0:12879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920552.950793:0:12879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb029ee400/0x2a4915844546a0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a0d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920552.950808:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920552.950810:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920552.950812:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920552.950828:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972230656:0@lo:400:kworker.0 00000100:00100000:1.0:1790920552.950974:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1877915972230784:0@lo:39:umount.0 00000400:00000100:1.0:1790920552.951031:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877915972230784 offset 0 length 224: 4 00010000:00010000:3.0:1790920553.513114:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920554.537002:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790920555.112829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790920555.112840:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1790920555.561934:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920556.585383:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920557.609006:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920558.635643:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920559.660403:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920560.234043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790920560.234054:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790920560.682761:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920561.706389:0:12879:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920562.155152:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790920552/real 1790920552] req@ffff88eb33f70700 x1877915972230784/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790920562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920562.155205:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88eb33f70700 x1877915972230784/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790920562 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790920562.155231:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f97a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790920562.155255:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1877915972230784:0@lo:39:umount.0 00000100:00080000:3.0:1790920562.155850:0:13184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790920562.155858:0:13184:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790920562.155865:0:13184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790920562.156890:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.156909:0:13184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.156916:0:13184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.156924:0:13184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.156979:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920562.156990:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.156997:0:13184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.157003:0:13184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.157009:0:13184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920562.157037:0:13184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790920562.157043:0:13184:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790920562.157073:0:13184:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790920562.157078:0:13184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790920562.157084:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790920562.157091:0:13184:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790920562.157097:0:13184:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff88eb41feb380) has no exports 00000020:00080000:3.0:1790920562.157126:0:13184:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff88eb41feb380) has no exports 00010000:00010000:1.0:1790920562.157354:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790920562.157365:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157374:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00030000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920562.157379:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157388:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920562.157397:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920562.157403:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790920562.157405:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1790920562.157408:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1790920562.157425:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88eb0563d800 00010000:00010000:1.0:1790920562.157429:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157436:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00030000/0x2a4915844546a0d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a0de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157463:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920562.157467:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157472:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb00031000 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920562.157475:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157482:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920562.157489:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920562.157494:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790920562.157496:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790920562.157498:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790920562.157502:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88eb0563d800 00010000:00010000:1.0:1790920562.157504:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157510:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00031000/0x2a4915844546a30e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a315 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920562.157523:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920562.157525:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920562.157527:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920562.159212:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790920562.169624:0:13184:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88eb051e9d20 - data ffff88eb2c5b55e8/ffff88eb3f665000 00000020:01000000:3.0:1790920562.170963:0:13184:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88eb050a0d20 - data ffff88eb2c713bd0/ffff88ea013f1400 00100000:10000000:3.0:1790920562.182870:0:13184:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790920562.221682:0:13184:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469fcd 00000020:00000080:0.0:1790920562.221695:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb3fb09800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790920562.221782:0:13184:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb3a4ce000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790920562.221788:0:13184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb3a4ce000 2 00000020:01000004:0.0:1790920562.221792:0:13184:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88eb3a4ce000 from lustre-OST0001 00000020:00000080:0.0:1790920562.221825:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790920562.221839:0:13184:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790920562.221844:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb3fb09000/lustre-OST0001_UUID 00000020:00000080:0.0:1790920562.221847:0:13184:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3fb09000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790920562.221857:0:13184:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790920562.222253:0:13184:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c919bef2-7b4c-43c9-b63e-1d62f5af2ace->MGS 00010000:00010000:0.0:1790920562.222289:0:13184:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a49158445469ee6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920562.222305:0:13184:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a49158445469ee6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920562.222312:0:13184:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790920562.222315:0:13184:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790920562.222320:0:13184:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790920562.222338:0:13184:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88eb0563d800 00010000:00010000:0.0:1790920562.222343:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb00031400/0x2a49158445469edf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a49158445469ee6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920562.222361:0:13184:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2a4915844546a124 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920562.222369:0:13184:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2a4915844546a124 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920562.222391:0:13184:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790920562.222393:0:13184:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790920562.222395:0:13184:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790920562.222408:0:13184:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88eb0563d800 00010000:00010000:0.0:1790920562.222411:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb421ce000/0x2a4915844546a11d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2a4915844546a124 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790920562.222434:0:13184:0:(import.c:65:import_set_state_nolock()) ffff88eb0563d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790920562.222439:0:13184:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790920562.222442:0:13184:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790920562.222444:0:13184:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790920562.222450:0:13184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790920562.222466:0:13184:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88eb33f70000 x1877915972230528/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790920564 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790920562.222541:0:13184:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790920562.222545:0:13184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:1.0:1790920562.222776:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3fb09800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1790920562.225933:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c919bef2-7b4c-43c9-b63e-1d62f5af2ace:3303:1877915972230528:0@lo:250:kworker.0 10000000:01000000:0.0:1790920562.226198:0:13184:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790920562.226216:0:13184:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469dc0 00000020:00000080:0.0:1790920562.226229:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb0563a800/c919bef2-7b4c-43c9-b63e-1d62f5af2ace 00000020:01000000:0.0:1790920562.226252:0:13184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.134@tcp (flags='') 00000020:00000080:0.0:1790920562.226278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb0563a800/c919bef2-7b4c-43c9-b63e-1d62f5af2ace for MGC192.168.204.134@tcp 00000020:00000080:0.0:1790920562.226300:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790920562.226312:0:13184:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.134@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790920562.226317:0:13184:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff88eb05f10000) has no exports 10000000:01000000:0.0:1790920562.226339:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790920562.226441:0:13184:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.134@tcp: client import never connected 00000100:00080000:0.0:1790920562.226445:0:13184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790920562.226450:0:13184:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790920562.226453:0:13184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790920562.226456:0:13184:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790920562.226506:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb0563d800 for MGC192.168.204.134@tcp 00000020:00000080:0.0:1790920562.226548:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790920562.226557:0:13184:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.134@tcp (uuid c919bef2-7b4c-43c9-b63e-1d62f5af2ace) 00000020:00000080:0.0:1790920562.226561:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb0563e800/c919bef2-7b4c-43c9-b63e-1d62f5af2ace 00000020:00000080:0.0:1790920562.226563:0:13184:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb0563e800/c919bef2-7b4c-43c9-b63e-1d62f5af2ace for MGC192.168.204.134@tcp 00000020:01000000:0.0:1790920562.226569:0:13184:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.134@tcp (c919bef2-7b4c-43c9-b63e-1d62f5af2ace) 00000020:01000000:0.0:1790920562.226919:0:13184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790920562.226924:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790920562.226930:0:13184:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790920562.226936:0:13184:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88eb3f978800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790920562.226942:0:13184:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff88eb18010000) has exports, disconnecting them 00000020:00080000:0.0:1790920562.226948:0:13184:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88eb3f978800), last request at 1790920334 00000020:00000080:0.0:1790920562.226953:0:13184:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469ff7 00000020:00080000:0.0:1790920562.226966:0:13184:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88eb3f978800): rc 0 00000020:00000080:0.0:1790920562.226970:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb3f978800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790920562.227024:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3f978800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1790920562.228812:0:13184:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1790920562.228832:0:13184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790920562.228838:0:13184:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790920562.228845:0:13184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790920562.229098:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88eb3f97a000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1790920562.230852:0:12879:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1790920562.231209:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790920562.231689:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1790920562.232063:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88eb0716b800:5828] 0 exiting: rc = 1 00000100:00100000:1.0:1790920562.232965:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88eb03858e00:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1790920562.233259:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.233630:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff88eb03859400:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1790920562.234911:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88eb03859a00:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1790920562.235197:0:8460:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff88eb3f4b2e00:8460] 3 exiting: rc = 0 00000100:00100000:1.0:1790920562.236947:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88eb03859000:5831] 1 exiting: rc = 0 00000100:00100000:2.0:1790920562.237188:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237200:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237226:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237233:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237240:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237253:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237260:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237276:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237283:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237294:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237301:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237308:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237315:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237322:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237329:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237337:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237344:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237350:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237356:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237362:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237368:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237373:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237379:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237384:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237390:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237396:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237402:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237408:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237413:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237424:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237430:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237436:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237441:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237446:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237451:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237458:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237463:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237475:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237480:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237485:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237491:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237497:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237504:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237509:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237514:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237519:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237524:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237530:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237535:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237540:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237544:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237552:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237557:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237562:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237567:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237572:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237577:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237582:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237587:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237592:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237597:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237602:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237608:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.237613:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790920562.239286:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790920562.239305:0:13184:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790920562.239313:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb07067800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790920562.239319:0:13184:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb07067800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790920562.239334:0:13184:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1790920562.239388:0:13184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb3a4ce000 1 00000020:00000080:2.0:1790920562.239396:0:13184:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2a49158445469f9c 00000020:00000080:2.0:1790920562.239414:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb3a4fb000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1790920562.239431:0:13184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1790920562.239445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a4fb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790920562.239459:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790920562.239466:0:13184:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790920562.239471:0:13184:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff88eb41c04d40) has no exports 00000020:00000080:1.0:1790920562.256294:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920562.256316:0:13184:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790920562.256324:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb3a4cc000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790920562.256330:0:13184:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb3a4cc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790920562.256348:0:13184:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790920562.257383:0:13184:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88eb3a4c9800 00000020:01000000:1.0:1790920562.257481:0:13184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790920562.257487:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790920562.257493:0:13184:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790920562.257498:0:13184:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff88eb3b9d3380) has no exports 00000020:00000080:1.0:1790920562.257526:0:13184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790920562.257534:0:13184:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790920562.257537:0:13184:0:(genops.c:885:class_export_put()) final put ffff88eb05924000/OSS_uuid 00000020:00000080:1.0:1790920562.257540:0:13184:0:(genops.c:844:class_export_destroy()) destroying export ffff88eb05924000/OSS_uuid for OSS 00000020:01000000:1.0:1790920562.257549:0:13184:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1790920562.257581:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1790920562.257791:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff88eb05fad000:6690] 2 exiting: rc = 0 00000100:00100000:1.0:1790920562.258542:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff88eb33ba4400:6689] 1 exiting: rc = 0 00000100:00100000:1.0:1790920562.258659:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff88eb05818200:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1790920562.259149:0:8267:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff88eb3af05a00:8267] 3 exiting: rc = 0 00000100:00100000:1.0:1790920562.259373:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259388:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259396:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259404:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259410:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259416:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259421:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259426:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259431:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259440:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259445:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259451:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259457:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259463:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259468:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259473:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259478:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259484:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259489:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259494:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259504:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259511:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259516:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259521:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259526:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259531:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259536:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259541:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259545:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259550:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259555:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259560:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259565:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.259570:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260175:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260206:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260373:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260521:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260527:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260532:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260538:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260544:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260549:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260556:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260561:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260566:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260573:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260578:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260583:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260588:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260593:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260599:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260604:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260609:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260614:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260619:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260627:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260633:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260638:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260642:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260647:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260652:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260656:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.260662:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.262983:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff88eb05fade00:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1790920562.263095:0:7079:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff88eb0707dc00:7079] 2 exiting: rc = 0 00000100:00100000:3.0:1790920562.263443:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff88eb05fad600:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1790920562.263598:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263610:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263615:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263621:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263640:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263646:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263652:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263657:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263663:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263668:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263673:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263678:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263683:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263688:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263693:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263697:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263702:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263707:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263711:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263716:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263721:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263726:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263732:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263738:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263935:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263957:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263965:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263971:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263976:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263982:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.263988:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264000:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264006:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264012:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264017:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264023:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264028:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264034:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264042:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264057:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264063:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264069:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264076:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264081:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264088:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264093:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264100:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264107:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264113:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264119:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264130:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264137:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264143:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264149:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264154:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264160:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264165:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264172:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264178:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264188:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264196:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264202:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264209:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.264221:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.265899:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff88eb33cc5000:6694] 1 exiting: rc = 0 00000100:00100000:1.0:1790920562.266135:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff88eb33cc4e00:6695] 2 exiting: rc = 0 00000100:00100000:2.0:1790920562.266422:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff88eb05faca00:6693] 0 exiting: rc = 1 00000100:00100000:1.0:1790920562.266549:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266557:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266564:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266570:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266577:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266584:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266591:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266598:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266604:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266629:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266636:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266643:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266652:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266667:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266675:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266682:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266689:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266695:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266702:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266709:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266716:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266723:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266729:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266736:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266950:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266964:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266970:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266976:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.266983:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267127:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267137:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267144:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267150:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267157:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267164:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267171:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267177:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267200:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267208:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267215:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267222:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267230:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267237:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267243:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267259:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267281:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267289:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267296:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267304:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267311:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267318:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267323:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267329:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267336:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267343:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267350:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267356:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267364:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267370:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267376:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267382:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267390:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267398:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.267404:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.273614:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff88eb41ef0e00:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1790920562.273827:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff88eb41ef0c00:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1790920562.273965:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.273974:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.273980:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.273985:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274085:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274093:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274099:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274104:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274110:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274115:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274123:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274128:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274134:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274139:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274161:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274167:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274172:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274178:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274183:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274189:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274195:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274201:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274207:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274213:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274220:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274226:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274232:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274239:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274245:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274251:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274257:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274275:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274282:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274289:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274295:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274300:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274306:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274312:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274318:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274323:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274329:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274336:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274342:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274349:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274355:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274361:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274565:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274574:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274579:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274594:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274599:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274604:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274610:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274615:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274620:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274626:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274632:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274637:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274643:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274649:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274656:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274661:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274667:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790920562.274672:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.275709:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff88eb33cc5200:6698] 0 exiting: rc = 1 00000100:00100000:1.0:1790920562.275905:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff88eb41ef1c00:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1790920562.276257:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276280:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276287:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276295:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276302:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276309:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276316:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276322:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276329:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276354:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276362:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276369:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276375:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276383:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276389:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276396:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276403:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276413:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276421:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276428:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276437:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276460:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276479:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276486:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276493:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276504:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276512:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276520:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276527:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276535:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276541:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276548:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276554:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276577:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276586:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276592:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276598:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276607:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276614:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276623:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276629:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276639:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276646:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276654:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276661:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276683:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276692:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276700:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276709:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276717:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276727:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276736:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276778:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276788:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276798:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276805:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276812:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276845:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276853:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276859:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.276871:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.277072:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.277079:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790920562.277085:0:13184:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790920562.289204:0:13184:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790920581.845203:0:13802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790920591.980731:0:14262:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790920591.980736:0:14262:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790920591.980874:0:14262:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88eb3f5e5000 00000020:01000004:2.0:1790920591.980890:0:14262:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790920591.980899:0:14262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790920591.980913:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88eb06663380) 00000020:00000080:2.0:1790920591.980927:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790920591.997017:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790920591.999269:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1790920591.999651:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 461: rc = 0 00100000:10000000:3.0:1790920592.005261:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 461: rc = 0 00100000:10000000:3.0:1790920592.005489:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 461: rc = 0 00100000:10000000:3.0:1790920592.005584:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 461: rc = 0 00100000:10000000:3.0:1790920592.006017:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790920592.006105:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 461: rc = 0 00100000:10000000:3.0:1790920592.006429:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 461: rc = 0 00100000:10000000:3.0:1790920592.006837:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 463: rc = 0 00100000:10000000:3.0:1790920592.010860:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 769: rc = 0 00100000:10000000:3.0:1790920592.011056:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 769: rc = 0 00100000:10000000:3.0:1790920592.012550:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 605: rc = 0 00100000:10000000:3.0:1790920592.014245:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 605: rc = 0 00100000:10000000:3.0:1790920592.014743:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 605: rc = 0 00100000:10000000:3.0:1790920592.017092:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 605: rc = 0 00100000:10000000:3.0:1790920592.017599:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 605: rc = 0 00100000:10000000:3.0:1790920592.018175:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 605: rc = 0 00100000:10000000:2.0:1790920592.021540:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 605: rc = 0 00100000:10000000:2.0:1790920592.021901:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 605: rc = 0 00100000:10000000:2.0:1790920592.022149:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 605: rc = 0 00100000:10000000:2.0:1790920592.023171:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 605: rc = 0 00100000:10000000:2.0:1790920592.023506:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 605: rc = 0 00100000:10000000:2.0:1790920592.023792:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 605: rc = 0 00100000:10000000:2.0:1790920592.024740:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 782: rc = 0 00100000:10000000:2.0:1790920592.025038:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 782: rc = 0 00100000:10000000:2.0:1790920592.025426:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 782: rc = 0 00100000:10000000:2.0:1790920592.025715:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 782: rc = 0 00100000:10000000:2.0:1790920592.026045:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 782: rc = 0 00100000:10000000:2.0:1790920592.026283:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 782: rc = 0 00100000:10000000:2.0:1790920592.026506:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 782: rc = 0 00100000:10000000:2.0:1790920592.026730:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 782: rc = 0 00100000:10000000:2.0:1790920592.027097:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 782: rc = 0 00100000:10000000:2.0:1790920592.027643:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 782: rc = 0 00100000:10000000:2.0:1790920592.028004:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 782: rc = 0 00100000:10000000:2.0:1790920592.028422:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 782: rc = 0 00100000:10000000:2.0:1790920592.028665:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 782: rc = 0 00100000:10000000:2.0:1790920592.034433:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 782: rc = 0 00100000:10000000:2.0:1790920592.034826:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 782: rc = 0 00100000:10000000:2.0:1790920592.035041:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 782: rc = 0 00100000:10000000:2.0:1790920592.035268:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 782: rc = 0 00100000:10000000:2.0:1790920592.035562:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 782: rc = 0 00100000:10000000:2.0:1790920592.035857:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 782: rc = 0 00100000:10000000:2.0:1790920592.036094:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 782: rc = 0 00100000:10000000:2.0:1790920592.037661:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 782: rc = 0 00100000:10000000:2.0:1790920592.038075:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 782: rc = 0 00100000:10000000:2.0:1790920592.039396:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 782: rc = 0 00100000:10000000:2.0:1790920592.039640:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 782: rc = 0 00100000:10000000:2.0:1790920592.040049:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 782: rc = 0 00100000:10000000:2.0:1790920592.040429:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 782: rc = 0 00100000:10000000:2.0:1790920592.040914:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 782: rc = 0 00100000:10000000:2.0:1790920592.041155:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 782: rc = 0 00100000:10000000:2.0:1790920592.041573:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 782: rc = 0 00100000:10000000:2.0:1790920592.042003:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 782: rc = 0 00100000:10000000:2.0:1790920592.042488:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 782: rc = 0 00100000:10000000:2.0:1790920592.042742:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 782: rc = 0 00100000:10000000:2.0:1790920592.044811:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 276: rc = 0 00100000:10000000:2.0:1790920592.046810:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790920592.046998:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 265: rc = 0 00100000:10000000:2.0:1790920592.047290:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790920592.047375:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 265: rc = 0 00100000:10000000:2.0:1790920592.047568:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790920592.047652:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 265: rc = 0 00100000:10000000:2.0:1790920592.048044:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790920592.048107:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:3.0:1790920592.051567:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790920592.051675:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:3.0:1790920592.051993:0:14262:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790920592.052056:0:14262:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00000020:00000080:3.0:1790920592.052395:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790920592.052403:0:14262:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790920592.052414:0:14262:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546b0b3 00000020:01000004:3.0:1790920592.052421:0:14262:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790920592.052427:0:14262:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790920592.052431:0:14262:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88eb3f5e5000 from MGS 00000020:01000004:3.0:1790920592.052435:0:14262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790920592.052444:0:14262:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff88eb41c019c0) 00000020:00000080:3.0:1790920592.052453:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790920592.052511:0:14262:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb3f5e5000 from MGS, refs=2 00080000:01000000:3.0:1790920592.052516:0:14262:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790920592.052521:0:14262:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546b0c1 00000100:00100000:3.0:1790920592.052611:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790920592.052896:0:14262:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790920592.052903:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790920592.053485:0:14262:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790920592.053492:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790920592.054539:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920592.054712:0:14262:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790920592.054717:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790920592.055652:0:14262:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790920592.055661:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790920592.058565:0:14262:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790920592.058576:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790920592.060180:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920592.060185:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920592.060187:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920592.066211:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920592.066221:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920592.066223:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920592.068100:0:14262:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790920592.071849:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790920592.081166:0:14262:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790920592.081187:0:14262:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790920592.081190:0:14262:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790920592.086173:0:14271:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790920592.086941:0:14262:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790920592.087078:0:14262:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790920592.087597:0:14262:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790920592.087921:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920592.088074:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790920592.088079:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790920592.092110:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790920592.092125:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790920592.100870:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790920592.100890:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790920592.106520:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790920592.106545:0:14262:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.134@tcp' 00000020:01000004:2.0:1790920592.106547:0:14262:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790920592.106579:0:14262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.134@tcp (typ=mgc) 00000020:00000080:2.0:1790920592.106591:0:14262:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.134@tcp (ffff88eb066619c0) 00000020:00000080:2.0:1790920592.106608:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790920592.106679:0:14262:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88ea027f4000@MGC192.168.204.134@tcp: add connection 192.168.204.134@tcp at head 00010000:00010000:2.0:1790920592.106907:0:14262:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.134@tcp-0 is initialized 00000040:01000000:2.0:1790920592.106913:0:14262:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790920592.108731:0:14277:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790920592.108794:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.134@tcp (uuid b6dbfc26-a70a-426c-a856-613d861b9981) 00000020:00000080:2.0:1790920592.108815:0:14262:0:(genops.c:1384:class_connect()) connect: client b6dbfc26-a70a-426c-a856-613d861b9981, cookie 0x2a4915844546b0cf 00000100:00080000:2.0:1790920592.108828:0:14262:0:(import.c:545:import_select_connection()) MGC192.168.204.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790920592.108840:0:14262:0:(import.c:666:import_select_connection()) MGC192.168.204.134@tcp: import ffff88ea027f4000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1790920592.108874:0:14262:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f573800 x1877915972230912/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790920592.108911:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b6dbfc26-a70a-426c-a856-613d861b9981:3303:1877915972230912:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790920592.108985:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920592.109053:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972230912 00000100:00100000:2.0:1790920592.109061:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972230912 00000100:00100000:2.0:1790920592.109098:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920592.109105:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1877915972230912:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1790920592.109126:0:14273:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b6dbfc26-a70a-426c-a856-613d861b9981@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1790920592.109149:0:14273:0:(genops.c:1384:class_connect()) connect: client b6dbfc26-a70a-426c-a856-613d861b9981, cookie 0x2a4915844546b0d6 00000100:00080000:2.0:1790920592.109275:0:14273:0:(import.c:65:import_set_state_nolock()) ffff88eb344b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790920592.109326:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+5:3303:x1877915972230912:12345-0@lo:250:mount.lustre.0 Request processed in 220us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.109333:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920592.109369:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790920592.109378:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.134@tcp: connect to target with instance 0 00000100:00080000:2.0:1790920592.109385:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790920592.109390:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790920592.109393:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88ea027f4000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790920592.109395:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790920592.109399:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790920592.109403:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b6dbfc26-a70a-426c-a856-613d861b9981:3303:1877915972230912:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1790920592.109422:0:14262:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b6dbfc26-a70a-426c-a856-613d861b9981->MGS 00000020:01000004:2.0:1790920592.109439:0:14262:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790920592.109460:0:14262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790920592.109473:0:14262:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff88eb06660000) 00000020:00000080:2.0:1790920592.109482:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1790920592.113111:0:14276:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1790920592.126901:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920592.132249:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790920592.132258:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790920592.133039:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790920592.133046:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790920592.133416:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790920592.133423:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790920592.135242:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920592.135401:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790920592.135406:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790920592.139882:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790920592.139897:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790920592.189406:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790920592.189611:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790920592.189619:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790920592.192735:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790920592.192795:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790920592.193446:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790920592.193624:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790920592.193629:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790920592.194052:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790920592.194061:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790920592.194729:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790920592.194910:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790920592.194915:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790920592.199130:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790920592.199142:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790920592.200240:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790920592.200428:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790920592.200434:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790920592.201695:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790920592.201706:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790920592.240967:0:14262:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790920592.241159:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790920592.241166:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790920592.247852:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790920592.247869:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790920592.248986:0:14262:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790920592.248995:0:14262:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790920592.263160:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790920592.263186:0:14262:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790920592.263193:0:14262:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790920592.263338:0:14262:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790920592.263371:0:14262:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790920592.263375:0:14262:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790920592.263377:0:14262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920592.263378:0:14262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920592.263380:0:14262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920592.263381:0:14262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920592.263383:0:14262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920592.263384:0:14262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920592.263386:0:14262:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920592.263387:0:14262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920592.263388:0:14262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920592.263391:0:14262:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790920592.263397:0:14262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790920592.263398:0:14262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920592.263399:0:14262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920592.263400:0:14262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920592.263401:0:14262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920592.263403:0:14262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920592.263404:0:14262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920592.263405:0:14262:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920592.263406:0:14262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920592.263407:0:14262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790920592.263441:0:14262:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790920592.263462:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790920592.263528:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920592.263580:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790920592.263841:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231040 00000100:00100000:0.0:1790920592.263849:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231040 00000100:00100000:0.0:1790920592.263898:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920592.263909:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+5:14262:x1877915972231040:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790920592.263957:0:14275:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790920592.263960:0:14275:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790920592.263963:0:14275:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790920592.264227:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790920592.265125:0:14275:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1790920592.266878:0:14297:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1790920592.266886:0:14297:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1790920592.266888:0:14297:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1790920592.266920:0:14297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790920592.267183:0:14275:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790920592.267193:0:14275:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790920592.278612:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+5:14262:x1877915972231040:12345-0@lo:253:mount.lustre.0 Request processed in 14696us (15075us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.278629:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790920592.278731:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790920592.278772:0:14262:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790920592.278775:0:14262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790920592.278777:0:14262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790920592.278778:0:14262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920592.278779:0:14262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920592.278780:0:14262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920592.278781:0:14262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920592.278783:0:14262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790920592.278784:0:14262:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790920592.278786:0:14262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920592.278788:0:14262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790920592.278809:0:14262:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88eb3f5e5000 from lustre-MDT0000 10000000:01000000:2.0:1790920592.278832:0:14262:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790920592.278835:0:14262:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790920592.278840:0:14262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88eb066619c0 10000000:01000000:2.0:1790920592.278844:0:14262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790920592.278853:0:14262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88eb066619c0 from 1 10000000:01000000:2.0:1790920592.278855:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790920592.278907:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.278917:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.278927:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920592.278947:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790920592.278983:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920592.279018:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920592.279168:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231168 00000100:00100000:3.0:1790920592.279175:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231168 00000100:00100000:3.0:1790920592.279214:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790920592.279223:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+5:14262:x1877915972231168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790920592.279234:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920592.279249:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36e00/0x2a4915844546b0eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b0e4 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.279271:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36e00/0x2a4915844546b0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b0e4 expref: 6 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.279292:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36e00/0x2a4915844546b0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b0e4 expref: 6 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.279312:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36e00, rc 0) 00000100:00100000:3.0:1790920592.279427:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+6:14262:x1877915972231168:12345-0@lo:101:mount.lustre.0 Request processed in 205us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920592.279434:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790920592.279540:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790920592.279555:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.279564:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.279613:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790920592.279641:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.279730:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f03000 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.280163:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231296 00000100:00100000:1.0:1790920592.280168:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231296 00000100:00100000:1.0:1790920592.280236:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790920592.280244:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+6:14262:x1877915972231296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920592.280490:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+6:14262:x1877915972231296:12345-0@lo:501:mount.lustre.0 Request processed in 246us (847us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790920592.280497:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920592.280562:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231296:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790920592.280593:0:14262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790920592.280618:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.280639:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920592.280649:0:14262:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88eb3f5e5000 10000000:01000000:0.0:1790920592.280653:0:14262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790920592.280658:0:14262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88eb3f5e5000 10000000:01000000:0.0:1790920592.280660:0:14262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790920592.280663:0:14262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88eb3f5e5000 from 1 10000000:01000000:0.0:1790920592.280666:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790920592.280702:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52400/0x2a4915844546b0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.280709:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52400/0x2a4915844546b0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.280729:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52400/0x2a4915844546b0f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.280744:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790920592.280793:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.281456:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f03000 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.281522:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231424 00000100:00100000:2.0:1790920592.281528:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231424 00000100:00100000:2.0:1790920592.281555:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920592.281563:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+6:14262:x1877915972231424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790920592.281573:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920592.281587:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56a400/0x2a4915844546b0f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b0f2 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.281607:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56a400/0x2a4915844546b0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b0f2 expref: 7 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.281618:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56a400/0x2a4915844546b0f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b0f2 expref: 7 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.281626:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56a400, rc 0) 00000100:00100000:2.0:1790920592.281672:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+7:14262:x1877915972231424:12345-0@lo:101:mount.lustre.0 Request processed in 109us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.281678:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790920592.281908:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790920592.281922:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52400/0x2a4915844546b0f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0f9 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.281931:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52400/0x2a4915844546b0f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b0f9 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920592.281956:0:14262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790920592.281974:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52400/0x2a4915844546b0f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0f9 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.281982:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52400/0x2a4915844546b0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0f9 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920592.281990:0:14262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790920592.281994:0:14262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790920592.281999:0:14262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88eb3f5e5000 10000000:01000000:0.0:1790920592.282002:0:14262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790920592.282005:0:14262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790920592.282008:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790920592.282024:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52a00/0x2a4915844546b100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.282031:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52a00/0x2a4915844546b100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.282039:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52a00/0x2a4915844546b100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.282052:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790920592.282081:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.282098:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f03000 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.282200:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231552 00000100:00100000:2.0:1790920592.282204:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231552 00000100:00100000:2.0:1790920592.282222:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920592.282227:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+7:14262:x1877915972231552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790920592.282234:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920592.282243:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56ae00/0x2a4915844546b107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b100 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.282257:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56ae00/0x2a4915844546b107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b100 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.282266:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56ae00/0x2a4915844546b107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b100 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.282273:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56ae00, rc 0) 00000100:00100000:2.0:1790920592.282314:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+8:14262:x1877915972231552:12345-0@lo:101:mount.lustre.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.282321:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790920592.282476:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790920592.282487:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52a00/0x2a4915844546b100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b107 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.282501:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52a00/0x2a4915844546b100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b107 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.282546:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790920592.282569:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.282588:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f03000 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.282625:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231680 00000100:00100000:2.0:1790920592.282629:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231680 00000100:00100000:2.0:1790920592.282655:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790920592.282661:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+8:14262:x1877915972231680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920592.283383:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+9:14262:x1877915972231680:12345-0@lo:501:mount.lustre.0 Request processed in 720us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.283393:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790920592.284896:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920592.285237:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790920592.285374:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920592.285444:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05134900 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.285485:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231808 00000100:00100000:2.0:1790920592.285491:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231808 00000100:00100000:2.0:1790920592.285562:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790920592.285571:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+9:14262:x1877915972231808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790920592.286230:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+9:14262:x1877915972231808:12345-0@lo:503:mount.lustre.0 Request processed in 659us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.286240:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920592.286390:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972231808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790920592.287203:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14298:1877915972231936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920592.287257:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920592.287388:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972231936 00000100:00100000:3.0:1790920592.287394:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972231936 00000100:00100000:3.0:1790920592.287435:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790920592.287443:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+9:14298:x1877915972231936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920592.287728:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+9:14298:x1877915972231936:12345-0@lo:502:llog_process_th.0 Request processed in 272us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920592.287736:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790920592.288030:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2180 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.288051:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14298:1877915972231936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790920592.288076:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790920592.288086:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920592.288088:0:14298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790920592.288094:0:14298:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790920592.288097:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790920592.288110:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff88eb06664d40) 00000020:00000080:2.0:1790920592.288129:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790920592.288133:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790920592.288202:0:14298:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790920592.288210:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546b115 00000020:00000080:2.0:1790920592.288500:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790920592.288505:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920592.288509:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920592.288511:0:14298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790920592.288514:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790920592.288517:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920592.288519:0:14298:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790920592.288522:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790920592.288537:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff88eb34593380) 00000020:00000080:2.0:1790920592.288547:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790920592.288552:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790920592.288554:0:14298:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790920592.288562:0:14298:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790920592.288568:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790920592.288607:0:14298:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb3f5e5000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790920592.288619:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff88eb345919c0) 00000020:00000080:2.0:1790920592.288630:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790920592.288672:0:14298:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790920592.288676:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a4915844546b12a 00000020:00000080:2.0:1790920592.288807:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790920592.288812:0:14298:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790920592.288817:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2a4915844546b131 00080000:01000000:2.0:1790920592.288821:0:14298:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790920592.288824:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546b138 00010000:00010000:2.0:1790920592.380169:0:14298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790920592.380578:0:14298:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1790920592.385482:0:14298:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790920592.386067:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff88eb34590000) 00000020:00000080:2.0:1790920592.386086:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790920592.386170:0:14298:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790920592.386178:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546b146 00000020:00000080:0.0:1790920592.400699:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790920592.407948:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2a4915844546b14d 00000020:00000080:0.0:1790920592.410603:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790920592.410617:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920592.410624:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.410627:0:14298:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790920592.410631:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920592.410638:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.410639:0:14298:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790920592.410643:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790920592.410695:0:14298:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790920592.410711:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920592.410714:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.410716:0:14298:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790920592.410719:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790920592.410721:0:14298:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1790920592.410722:0:14298:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790920592.410724:0:14298:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790920592.410726:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790920592.410728:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.410729:0:14298:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790920592.410731:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790920592.410762:0:14298:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790920592.410767:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.410769:0:14298:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790920592.410773:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790920592.410779:0:14298:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:0.0:1790920592.410803:0:14298:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790920592.410807:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790920592.410821:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88eb18014d40) 00000020:00000080:0.0:1790920592.410838:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790920592.410843:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790920592.410914:0:14298:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790920592.410920:0:14298:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790920592.410927:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546b15b 00010000:00080000:0.0:1790920592.410957:0:14298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb3f668800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:0.0:1790920592.411204:0:14298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1790920592.419688:0:14298:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790920592.419802:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790920592.426710:0:14298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790920592.426836:0:14298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790920592.426941:0:14298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790920592.428159:0:14302:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790920592.428165:0:14302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790920592.430088:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790920592.430104:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790920592.430137:0:14298:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790920592.430157:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a4915844546b162 00000100:00080000:1.0:1790920592.430167:0:14298:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790920592.430179:0:14298:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88eb3f668800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1790920592.430215:0:14298:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f656d80 x1877915972232064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790920592.430337:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972232064:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790920592.430387:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877915972232064 offset 0 length 520: 4 00000100:00080000:1.0:1790920592.430452:0:14298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790920592.430562:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920592.430567:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.430569:0:14298:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790920592.430572:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790920592.430575:0:14298:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1790920592.430577:0:14298:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790920592.430579:0:14298:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790920592.430590:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790920592.430593:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.430595:0:14298:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790920592.430597:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790920592.430602:0:14298:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790920592.430605:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.430607:0:14298:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790920592.430609:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790920592.430613:0:14298:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:1.0:1790920592.430636:0:14298:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790920592.430639:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790920592.430652:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88eb41fe99c0) 00000020:00000080:1.0:1790920592.430665:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790920592.430688:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790920592.431397:0:14298:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790920592.431407:0:14298:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790920592.431415:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2a4915844546b170 00010000:00080000:1.0:1790920592.431445:0:14298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb09b00000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1790920592.431705:0:14298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1790920592.431922:0:14298:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790920592.431946:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790920592.435102:0:14298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790920592.435258:0:14298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1790920592.435375:0:14298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1790920592.436177:0:14304:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790920592.436183:0:14304:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790920592.436898:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790920592.436910:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790920592.436941:0:14298:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790920592.436959:0:14298:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a4915844546b177 00000100:00080000:1.0:1790920592.436969:0:14298:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790920592.436980:0:14298:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88eb09b00000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1790920592.437016:0:14298:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f657800 x1877915972232192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790920592.437046:0:14298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790920592.437094:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920592.437098:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.437100:0:14298:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790920592.437102:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920592.437106:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.437107:0:14298:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790920592.437110:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790920592.437112:0:14298:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790920592.437114:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920592.437116:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.437117:0:14298:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790920592.437119:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920592.437122:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.437123:0:14298:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790920592.437126:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790920592.437161:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14298:1877915972232320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920592.437486:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972232192:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790920592.437529:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877915972232192 offset 0 length 520: 4 00000100:00100000:1.0:1790920592.437851:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920592.437876:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb07fa2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.437923:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972232320 00000100:00100000:2.0:1790920592.437931:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972232320 00000100:00100000:2.0:1790920592.437977:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790920592.437986:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+9:14298:x1877915972232320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920592.438281:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+9:14298:x1877915972232320:12345-0@lo:502:llog_process_th.0 Request processed in 295us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.438289:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790920592.438402:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14298:1877915972232320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790920592.438432:0:14298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920592.438438:0:14298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920592.438440:0:14298:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790920592.438444:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790920592.438597:0:14262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1790920592.438620:0:14262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790920592.438642:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52a00/0x2a4915844546b100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b107 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.438654:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52a00/0x2a4915844546b100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b107 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920592.438664:0:14262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb3f5e5000 from 1 10000000:01000000:2.0:1790920592.438667:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790920592.438714:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.438723:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.438734:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920592.438778:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790920592.438811:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920592.438830:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.438927:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972232448 00000100:00100000:1.0:1790920592.438933:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972232448 00000100:00100000:1.0:1790920592.438963:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790920592.438971:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+9:14262:x1877915972232448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920592.438981:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920592.439004:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b17e expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.439025:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b17e expref: 10 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.439037:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b17e expref: 10 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.439045:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443dc00, rc 0) 00000100:00100000:1.0:1790920592.439088:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+10:14262:x1877915972232448:12345-0@lo:101:mount.lustre.0 Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.439095:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790920592.439157:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790920592.439170:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.439179:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920592.439736:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232576:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790920592.439874:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920592.439904:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.440041:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972232576 00000100:00100000:1.0:1790920592.440046:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972232576 00000100:00100000:1.0:1790920592.440081:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790920592.440089:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+10:14262:x1877915972232576:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790920592.440104:0:14274:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790920592.440110:0:14274:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790920592.440175:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+10:14262:x1877915972232576:12345-0@lo:256:mount.lustre.0 Request processed in 87us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.440183:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790920592.440407:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232576:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790920592.441090:0:14262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790920592.441110:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.441122:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920592.441130:0:14262:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3f5e5000 from 1 10000000:01000000:3.0:1790920592.441133:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790920592.441161:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.441169:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.441179:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920592.441196:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790920592.441237:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920592.441255:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.441431:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972232704 00000100:00100000:1.0:1790920592.441438:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972232704 00000100:00100000:1.0:1790920592.441476:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790920592.441483:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+10:14262:x1877915972232704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920592.441494:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920592.441508:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b18c expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.441544:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b18c expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.441554:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b18c expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.441562:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443da00, rc 0) 00000100:00100000:1.0:1790920592.441594:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+11:14262:x1877915972232704:12345-0@lo:101:mount.lustre.0 Request processed in 111us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.441600:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790920592.441935:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790920592.441950:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.441958:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920592.442022:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920592.442050:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920592.442117:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.442357:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972232832 00000100:00100000:1.0:1790920592.442363:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972232832 00000100:00100000:1.0:1790920592.442428:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790920592.442437:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+11:14262:x1877915972232832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920592.442863:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+11:14262:x1877915972232832:12345-0@lo:501:mount.lustre.0 Request processed in 427us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.442870:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790920592.442952:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790920592.442990:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790920592.443032:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.443210:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f03c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920592.443326:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972232960 00000100:00100000:3.0:1790920592.443332:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972232960 00000100:00100000:3.0:1790920592.443356:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790920592.443362:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+11:14262:x1877915972232960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790920592.443608:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+11:14262:x1877915972232960:12345-0@lo:503:mount.lustre.0 Request processed in 244us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920592.443616:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790920592.444019:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972232960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790920592.444479:0:14306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14306:1877915972233088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920592.444525:0:14306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.444592:0:14306:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f03b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920592.444662:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233088 00000100:00100000:3.0:1790920592.444667:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233088 00000100:00100000:3.0:1790920592.444775:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790920592.444783:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+11:14306:x1877915972233088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790920592.445009:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+11:14306:x1877915972233088:12345-0@lo:502:llog_process_th.0 Request processed in 226us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920592.445016:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790920592.445143:0:14306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14306:1877915972233088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790920592.445171:0:14306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920592.445180:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.445183:0:14306:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790920592.445196:0:14306:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb3f5e5000 00000020:00000080:0.0:1790920592.445199:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790920592.445206:0:14306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920592.445208:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.445210:0:14306:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790920592.445212:0:14306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920592.445214:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.445215:0:14306:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790920592.445219:0:14306:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb3f5e5000 00000020:00000080:0.0:1790920592.445221:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790920592.445286:0:14306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920592.445290:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.445291:0:14306:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790920592.445294:0:14306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920592.445296:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.445298:0:14306:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790920592.445301:0:14306:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88eb3f5e5000 00000020:00000080:0.0:1790920592.445303:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790920592.445337:0:14306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14306:1877915972233216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790920592.445372:0:14306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.445809:0:14306:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f03b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.445855:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233216 00000100:00100000:1.0:1790920592.445861:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233216 00000100:00100000:1.0:1790920592.445887:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790920592.445894:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+11:14306:x1877915972233216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920592.446119:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+11:14306:x1877915972233216:12345-0@lo:502:llog_process_th.0 Request processed in 224us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.446127:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790920592.447371:0:14306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14306:1877915972233216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790920592.447414:0:14306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920592.447421:0:14306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920592.447423:0:14306:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790920592.447427:0:14306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790920592.457122:0:14262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790920592.457162:0:14262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790920592.457191:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.457216:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920592.457265:0:14262:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790920592.457269:0:14262:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88eb3f5e5000 10000000:01000000:2.0:1790920592.457272:0:14262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88eb3f5e5000 10000000:01000000:2.0:1790920592.457276:0:14262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790920592.457282:0:14262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb3f5e5000 from 1 10000000:01000000:2.0:1790920592.457285:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790920592.457321:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a200/0x2a4915844546b19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.457329:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a200/0x2a4915844546b19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.457342:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a200/0x2a4915844546b19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920592.457367:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972233344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790920592.457437:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920592.457573:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.457640:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233344 00000100:00100000:1.0:1790920592.457648:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233344 00000100:00100000:1.0:1790920592.457780:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790920592.457790:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+11:14262:x1877915972233344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920592.457804:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920592.457817:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443c000/0x2a4915844546b1a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b19a expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.457842:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443c000/0x2a4915844546b1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b19a expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.457853:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443c000/0x2a4915844546b1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b19a expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.457862:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c000, rc 0) 00000100:00100000:1.0:1790920592.457903:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+12:14262:x1877915972233344:12345-0@lo:101:mount.lustre.0 Request processed in 115us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.457909:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790920592.457995:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972233344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790920592.458009:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a200/0x2a4915844546b19a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1a1 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920592.458019:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a200/0x2a4915844546b19a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b1a1 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920592.458078:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972233472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920592.458103:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920592.461233:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920592.464188:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233472 00000100:00100000:3.0:1790920592.464202:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233472 00000100:00100000:3.0:1790920592.464248:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790920592.464257:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14262:x1877915972233472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920592.464524:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14262:x1877915972233472:12345-0@lo:501:mount.lustre.0 Request processed in 268us (6419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920592.464532:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790920592.464623:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972233472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920592.464671:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972233600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790920592.470370:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920592.470422:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920592.470609:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233600 00000100:00100000:3.0:1790920592.470622:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233600 00000100:00100000:3.0:1790920592.470719:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790920592.470729:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14262:x1877915972233600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790920592.470927:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14262:x1877915972233600:12345-0@lo:503:mount.lustre.0 Request processed in 199us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920592.470935:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790920592.473616:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972233600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790920592.480990:0:14312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14312:1877915972233728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920592.481078:0:14312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920592.481125:0:14312:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb33cdda80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.481366:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233728 00000100:00100000:2.0:1790920592.481374:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233728 00000100:00100000:2.0:1790920592.481420:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790920592.481428:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+12:14312:x1877915972233728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920592.481674:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+12:14312:x1877915972233728:12345-0@lo:502:llog_process_th.0 Request processed in 246us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.481693:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790920592.481799:0:14312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14312:1877915972233728:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790920592.481857:0:14312:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790920592.481872:0:14312:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88eb41fe8000) 00000020:00000080:1.0:1790920592.481890:0:14312:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1790920592.481968:0:14312:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb3f5e5000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790920592.481972:0:14312:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb3f5e5000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790920592.481975:0:14312:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb3f5e5000 4 00010000:00080000:1.0:1790920592.482002:0:14312:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb32dc9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1790920592.486074:0:14312:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1790920592.486538:0:14312:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790920592.486572:0:14312:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790920592.486584:0:14312:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2a4915844546b1af 00000100:00080000:1.0:1790920592.486594:0:14312:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790920592.486606:0:14312:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88eb32dc9800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1790920592.486637:0:14312:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f655c00 x1877915972233856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790920592.486667:0:14312:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790920592.486852:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972233856:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790920592.486921:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920592.487087:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233856 00000100:00100000:1.0:1790920592.487093:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233856 00000100:00100000:1.0:1790920592.487123:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920592.487130:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1877915972233856:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790920592.487195:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1877915972233856:12345-0@lo:38:llog_process_th.0 Request processed in 64us (273us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790920592.487202:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920592.487367:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790920592.487375:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb32dc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790920592.487379:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790920592.487383:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972233856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790920592.487581:0:14312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14312:1877915972233984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790920592.487626:0:14312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920592.487647:0:14312:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3b3ba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920592.487953:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972233984 00000100:00100000:2.0:1790920592.487958:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972233984 00000100:00100000:2.0:1790920592.487997:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790920592.488003:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14312:x1877915972233984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790920592.488774:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14312:x1877915972233984:12345-0@lo:502:llog_process_th.0 Request processed in 744us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920592.488784:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790920592.491099:0:14312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b6dbfc26-a70a-426c-a856-613d861b9981:14312:1877915972233984:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790920592.491159:0:14312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790920592.491547:0:14262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790920592.491571:0:14262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790920592.491589:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a200/0x2a4915844546b19a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1a1 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920592.491602:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a200/0x2a4915844546b19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1a1 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790920592.491653:0:14262:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790920592.491655:0:14262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790920592.491657:0:14262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920592.491658:0:14262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920592.491659:0:14262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920592.491661:0:14262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920592.491662:0:14262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790920592.491663:0:14262:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790920592.491665:0:14262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920592.491666:0:14262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790920592.491670:0:14262:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790920592.491673:0:14262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790920592.491674:0:14262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790920592.491687:0:14262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920592.491688:0:14262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920592.491689:0:14262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920592.491691:0:14262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920592.491692:0:14262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790920592.491693:0:14262:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790920592.491694:0:14262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920592.491701:0:14262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790920592.491724:0:14262:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790920592.491741:0:14262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972234112:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790920592.491834:0:14262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920592.491869:0:14262:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d406c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920592.491894:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972234112 00000100:00100000:3.0:1790920592.491901:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972234112 00000100:00100000:3.0:1790920592.491942:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920592.491950:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14262:x1877915972234112:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790920592.491989:0:14274:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790920592.492002:0:14274:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790920592.537090:0:14274:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790920592.537109:0:14274:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790920592.540834:0:14296:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790920592.540846:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790920592.540874:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.540895:0:14296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b17e expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.540918:0:14296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.540960:0:14296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546b17e expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.540975:0:14296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546b17e expref: 12 pid: 14273 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.540990:0:14296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14296:1877915972234240:0@lo:104: 00000100:00100000:0.0:1790920592.541068:0:14296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920592.541114:0:14296:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920592.541415:0:14263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972234240 00000100:00100000:1.0:1790920592.541424:0:14263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972234240 00000100:00100000:1.0:1790920592.541468:0:14263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920592.541478:0:14263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b6dbfc26-a70a-426c-a856-613d861b9981+3:14296:x1877915972234240:12345-0@lo:104: 00010000:00010000:1.0:1790920592.541492:0:14263:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.541560:0:14263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790920592.541567:0:14263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b6dbfc26-a70a-426c-a856-613d861b9981+3:14296:x1877915972234240:12345-0@lo:104: Request processed in 91us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920592.541576:0:14263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790920592.541600:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920592.541607:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.541615:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56bc00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:1.0:1790920592.541620:0:14269:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.541629:0:14269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790920592.541637:0:14269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790920592.541643:0:14269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790920592.541672:0:14269:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.541692:0:14269:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790920592.541712:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.541720:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb3f56bc00/0x2a4915844546b17e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b185 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.541785:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920592.541787:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920592.541789:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920592.541819:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972234368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920592.541848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920592.541925:0:14296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14296:1877915972234240:0@lo:104: 00010000:00010000:1.0:1790920592.541943:0:14296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.542065:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972234368 00000100:00100000:0.0:1790920592.542071:0:14265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972234368 00010000:00010000:0.0:1790920592.542092:0:14265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b17e expref: 13 pid: 14273 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.542112:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790920592.542119:0:14265:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6dbfc26-a70a-426c-a856-613d861b9981+13:3306:x1877915972234368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920592.542141:0:14265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920592.542147:0:14265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b17e expref: 13 pid: 14273 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542156:0:14265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546b17e expref: 13 pid: 14273 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542244:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3443dc00/0x2a4915844546b185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546b17e expref: 13 pid: 14273 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542270:0:14265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542278:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790920592.542361:0:14265:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001516301s 00010000:00010000:0.0:1790920592.542367:0:14265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542373:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542381:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542387:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542392:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920592.542396:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542403:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542416:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920592.542424:0:14265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920592.542463:0:14265:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6dbfc26-a70a-426c-a856-613d861b9981+12:3306:x1877915972234368:12345-0@lo:103:ldlm_bl.0 Request processed in 344us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920592.542470:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920592.545608:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972234368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790920592.545648:0:14296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.545660:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920592.545668:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b1b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920592.568270:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+11:14262:x1877915972234112:12345-0@lo:253:mount.lustre.0 Request processed in 76312us (76427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920592.568285:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920592.568738:0:14262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14262:1877915972234112:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790920592.568774:0:14262:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790920592.568779:0:14262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790920592.568780:0:14262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790920592.568782:0:14262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920592.568783:0:14262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920592.568784:0:14262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920592.568785:0:14262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920592.568787:0:14262:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790920592.568788:0:14262:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790920592.568791:0:14262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920592.568792:0:14262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790920592.568809:0:14262:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790920592.575924:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920592.576094:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790920592.576374:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920592.576530:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790920592.576808:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790920592.576959:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790920592.578223:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920592.578397:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790920592.578625:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920592.578897:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790920592.579147:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920592.579317:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1790920592.629591:0:14262:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1790920592.630116:0:14262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1790920592.630480:0:14320:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1790920592.630556:0:14320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1790920592.632110:0:14319:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1790920592.632116:0:14319:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1790920592.636545:0:14262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790920592.636705:0:14262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790920592.638649:0:14262:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790920592.638669:0:14262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790920592.639632:0:14262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920592.639795:0:14320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790920592.640012:0:14320:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790920592.640017:0:14320:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1790920592.642139:0:14262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790920592.643139:0:14262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790920592.643193:0:14262:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1790920592.646712:0:14262:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1790920592.653357:0:14262:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790920592.728741:0:14262:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790920592.728826:0:14262:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaea801ceb988 00100000:10000000:3.0:1790920592.728835:0:14262:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790920592.732083:0:14262:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790920592.732100:0:14262:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790920592.732121:0:14262:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790920592.732152:0:14262:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1790920593.129531:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790920593.513083:0:14277:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790920593.513091:0:14277:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb3f5e5000 from 6 10000000:01000000:1.0:1790920593.513096:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790920593.513147:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920593.513161:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920593.513174:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920593.513205:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972234496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790920593.513300:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920593.513358:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0a998d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790920593.513414:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972234496 00000100:00100000:2.0:1790920593.513423:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972234496 00000100:00100000:2.0:1790920593.513486:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790920593.513496:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+11:14277:x1877915972234496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920593.513511:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920593.513526:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b1bd expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920593.513549:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b1bd expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920593.513560:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b1bd expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920593.513569:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3f56b600, rc 0) 00000100:00100000:2.0:1790920593.513626:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972234496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920593.513646:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790920593.513734:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972234496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790920593.513787:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920593.513797:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920593.513851:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972234624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790920593.513884:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920593.513906:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb06696cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790920593.513961:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972234624 00000100:00100000:2.0:1790920593.513975:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972234624 00000100:00100000:2.0:1790920593.514004:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790920593.514010:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972234624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790920593.514024:0:14274:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790920593.514040:0:14274:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790920593.514042:0:14274:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790920593.514111:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972234624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920593.514117:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790920593.514141:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972234624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790920593.514178:0:14277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790920593.514185:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920593.514193:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920593.523504:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790920594.152898:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790920594.540736:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790920595.176992:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920596.201830:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920597.224953:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920597.611129:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790920597.611135:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790920597.611138:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790920597.611141:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790920597.611144:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790920597.611148:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790920597.611151:0:8:0:(import.c:65:import_set_state_nolock()) ffff88eb32dc9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790920597.611169:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88eb32dc9800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1790920597.611192:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f654e00 x1877915972234880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790920597.611232:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972234752:0@lo:400:kworker.0 00000100:00100000:1.0:1790920597.611296:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920597.614045:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972234880:0@lo:38:kworker.0 00000100:00100000:3.0:1790920597.614149:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920597.614394:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972234752 00000100:00100000:0.0:1790920597.614405:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972234752 00000100:00100000:1.0:1790920597.617005:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972234880 00000100:00100000:1.0:1790920597.617021:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972234880 00000100:00100000:1.0:1790920597.617116:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920597.617125:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877915972234880:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790920597.617154:0:14282:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1790920597.617190:0:14282:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2a4915844546b1cb 00000004:00100000:1.0:1790920597.617208:0:14282:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790920597.617349:0:14282:0:(import.c:65:import_set_state_nolock()) ffff88eb10672800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790920597.617455:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877915972234880:12345-0@lo:38:kworker.0 Request processed in 330us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920597.617462:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790920597.617783:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88eb3f654e00 x1877915972234880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790920607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790920597.617800:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790920597.617829:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790920597.617835:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790920597.617837:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb32dc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790920597.617845:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877915972234880:0@lo:38:kworker.0 00000100:00100000:3.0:1790920597.617912:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790920597.617921:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:3307:x1877915972234752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920597.617965:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:3307:x1877915972234752:12345-0@lo:400:kworker.0 Request processed in 46us (6669us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920597.617972:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790920597.618015:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972234752:0@lo:400:kworker.0 00000001:02000400:2.0:1790920598.091708:0:14563:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790920598.248880:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920599.272975:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920600.298963:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790920601.271604:0:14713:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdea769e0 20000000:00000080:2.0:1790920601.271620:0:14713:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88eb36562800 uarg=0000000000000000 20000000:01000000:2.0:1790920601.271652:0:14713:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790920601.271658:0:14713:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790920601.271668:0:14713:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790920601.272959:0:14714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1790920601.273218:0:14713:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790920601.279653:0:14713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790920601.280929:0:14713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920601.280950:0:14713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b18c expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920601.280960:0:14713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920601.281006:0:14713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546b18c expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920601.281021:0:14713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546b18c expref: 11 pid: 14274 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920601.281036:0:14713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14713:1877915972235008:0@lo:104: 00000100:00100000:0.0:1790920601.281109:0:14713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920601.281218:0:14713:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02f2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1790920601.281465:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972235008 00000100:00100000:2.0:1790920601.281473:0:14264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972235008 00000100:00100000:2.0:1790920601.281563:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790920601.281575:0:14264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+3:14713:x1877915972235008:12345-0@lo:104: 00010000:00010000:2.0:1790920601.281589:0:14264:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920601.281659:0:14264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790920601.281665:0:14264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+3:14713:x1877915972235008:12345-0@lo:104: Request processed in 94us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920601.281672:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790920601.281733:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920601.281741:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.281785:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37e00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:3.0:1790920601.281790:0:14268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.281798:0:14268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790920601.281806:0:14268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920601.281812:0:14268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790920601.281842:0:14268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.281848:0:14268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790920601.281867:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.281874:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb41e37e00/0x2a4915844546b18c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b193 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.281891:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920601.281893:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920601.281894:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920601.281923:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972235136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790920601.281955:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920601.282003:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972235136 00000100:00100000:3.0:1790920601.282006:0:14265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972235136 00010000:00010000:3.0:1790920601.282024:0:14265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b18c expref: 12 pid: 14274 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920601.282051:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790920601.282057:0:14265:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6dbfc26-a70a-426c-a856-613d861b9981+12:3304:x1877915972235136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790920601.282069:0:14265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920601.282074:0:14265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b18c expref: 12 pid: 14274 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282083:0:14265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546b18c expref: 12 pid: 14274 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282097:0:14265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282105:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282133:0:14265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282141:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282148:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282155:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282160:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920601.282164:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282178:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282188:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920601.282198:0:14265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920601.282230:0:14265:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6dbfc26-a70a-426c-a856-613d861b9981+12:3304:x1877915972235136:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920601.282237:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790920601.282277:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972235136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920601.282554:0:14713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3443da00/0x2a4915844546b193 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546b18c expref: 11 pid: 14274 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920601.282565:0:14713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14713:1877915972235008:0@lo:104: 00010000:00010000:0.0:1790920601.282577:0:14713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920601.282585:0:14713:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920601.282592:0:14713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920601.282609:0:14713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3ae53000/0x2a4915844546b1d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920601.321029:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920602.347875:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790920602.728947:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790920602.728955:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790920602.728958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790920602.728961:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790920602.729003:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790920602.729023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972235392:0@lo:400:kworker.0 00000100:00100000:1.0:1790920602.729122:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920602.729212:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972235392 00000100:00100000:1.0:1790920602.729220:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972235392 00000100:00100000:1.0:1790920602.729299:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920602.729307:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972235392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920602.729363:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972235392:12345-0@lo:400:kworker.0 Request processed in 56us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920602.729369:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790920602.729413:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88eb3f654700 x1877915972235392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920602.729427:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972235392:0@lo:400:kworker.0 00000100:00100000:3.0:1790920602.729651:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b6dbfc26-a70a-426c-a856-613d861b9981:3305:1877915972235264:0@lo:400:kworker.0 00000100:00100000:3.0:1790920602.729689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920602.729842:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972235264 00000100:00100000:1.0:1790920602.729847:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972235264 00000100:00100000:1.0:1790920602.729880:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790920602.729886:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+11:3305:x1877915972235264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920602.729923:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+11:3305:x1877915972235264:12345-0@lo:400:kworker.0 Request processed in 38us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920602.729929:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790920602.729977:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b6dbfc26-a70a-426c-a856-613d861b9981:3305:1877915972235264:0@lo:400:kworker.0 00000100:00100000:1.0:1790920602.731270:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790920592/real 1790920592] req@ffff88eb3f657800 x1877915972232192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920602.731300:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88eb3f657800 x1877915972232192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920602.731310:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790920592/real 1790920592] req@ffff88eb3f656d80 x1877915972232064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920602.731321:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88eb3f656d80 x1877915972232064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790920602.731355:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790920602.731380:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790920602.731384:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972232192:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790920602.731390:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f668800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790920602.731395:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790920602.731398:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972232064:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790920602.735519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790920602.735530:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790920602.735535:0:37:0:(import.c:65:import_set_state_nolock()) ffff88eb3f668800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790920602.735543:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1790920602.735550:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790920602.735566:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88eb3f668800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1790920602.735623:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f573100 x1877915972235520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790920602.735662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790920602.735666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790920602.735667:0:37:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790920602.735671:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1790920602.735690:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790920602.735696:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88eb09b00000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1790920602.735711:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f570a80 x1877915972235648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790920602.735946:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972235520:0@lo:8:kworker.0 00000400:00000100:0.0:1790920602.736017:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877915972235520 offset 0 length 520: 4 00000100:00100000:0.0:1790920602.736056:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972235648:0@lo:8:kworker.0 00000400:00000100:0.0:1790920602.736078:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877915972235648 offset 0 length 520: 4 10000000:01000000:3.0:1790920602.920959:0:14277:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790920602.920967:0:14277:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3f5e5000 from 10 10000000:01000000:3.0:1790920602.920973:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790920602.921024:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920602.921037:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920602.921048:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920602.921076:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972235776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920602.922020:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920602.922103:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d40840 going to sleep for 11 seconds 00000100:00100000:1.0:1790920602.922767:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972235776 00000100:00100000:1.0:1790920602.922778:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972235776 00000100:00100000:1.0:1790920602.922839:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790920602.922850:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+11:14277:x1877915972235776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920602.922879:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920602.922900:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b1d9 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920602.922925:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920602.922936:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920602.922943:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d000, rc 0) 00000100:00100000:1.0:1790920602.922997:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972235776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920602.923004:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790920602.923367:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972235776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920602.923387:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920602.923396:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920602.923472:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972235904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920602.923527:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920602.923564:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d40840 going to sleep for 11 seconds 00000100:00100000:2.0:1790920602.923611:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972235904 00000100:00100000:2.0:1790920602.923616:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972235904 00000100:00100000:2.0:1790920602.923655:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790920602.923664:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972235904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920602.923986:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972235904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920602.923993:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790920602.924312:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972235904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920602.924348:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972236032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920602.924396:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920602.924418:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d40840 going to sleep for 11 seconds 00000100:00100000:1.0:1790920602.924628:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236032 00000100:00100000:1.0:1790920602.924635:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236032 00000100:00100000:1.0:1790920602.924687:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790920602.924696:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972236032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920602.924993:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14277:x1877915972236032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 298us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920602.925000:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790920602.925195:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972236032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790920602.934392:0:14782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790920602.934713:0:14277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790920602.934741:0:14277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790920602.934779:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920602.934793:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920603.369087:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920604.393053:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790920604.782278:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790920605.419143:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920606.445319:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790920606.508072:0:14962:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790920606.508076:0:14962:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790920606.508228:0:14962:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88eb3a4cd800 00000020:01000004:2.0:1790920606.508244:0:14962:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790920606.508256:0:14962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790920606.508270:0:14962:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88eb34594d40) 00000020:00000080:2.0:1790920606.508287:0:14962:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790920606.538554:0:14962:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790920606.538896:0:14962:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790920606.540501:0:14962:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790920606.540965:0:14962:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790920606.541320:0:14962:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790920606.545244:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 693: rc = 0 00100000:10000000:3.0:1790920606.545356:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 693: rc = 0 00100000:10000000:3.0:1790920606.545801:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 693: rc = 0 00100000:10000000:3.0:1790920606.546490:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 563: rc = 0 00100000:10000000:3.0:1790920606.546990:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 563: rc = 0 00100000:10000000:3.0:1790920606.547284:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 563: rc = 0 00100000:10000000:3.0:1790920606.547509:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 563: rc = 0 00100000:10000000:3.0:1790920606.547935:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 563: rc = 0 00100000:10000000:3.0:1790920606.548263:0:14962:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 563: rc = 0 00000020:00000080:3.0:1790920606.549115:0:14962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790920606.549128:0:14962:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790920606.549139:0:14962:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2a4915844546b1ee 00000020:01000004:3.0:1790920606.549148:0:14962:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790920606.549170:0:14962:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790920606.549173:0:14962:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790920606.549179:0:14962:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790920606.549184:0:14962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790920606.549196:0:14962:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88eb41c04d40) 00000020:00000080:3.0:1790920606.549207:0:14962:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790920606.551517:0:14962:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920606.551958:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790920606.551965:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790920606.552433:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790920606.552439:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790920606.553183:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790920606.553191:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790920606.555961:0:14962:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920606.556161:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790920606.556167:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790920606.557275:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790920606.557284:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790920606.577939:0:14962:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920606.578178:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790920606.578185:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790920606.579508:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790920606.579518:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790920606.580306:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790920606.580317:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790920606.582401:0:14962:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920606.582604:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790920606.582610:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790920606.583471:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790920606.583481:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790920606.609006:0:14962:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790920606.609219:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790920606.609236:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790920606.610393:0:14962:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790920606.610414:0:14962:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790920606.610920:0:14962:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790920606.610947:0:14962:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790920606.610954:0:14962:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790920606.618538:0:14962:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790920606.618574:0:14962:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1790920606.618579:0:14962:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790920606.618581:0:14962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790920606.618582:0:14962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920606.618583:0:14962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920606.618584:0:14962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920606.618585:0:14962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920606.618587:0:14962:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790920606.618589:0:14962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920606.618590:0:14962:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790920606.618594:0:14962:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1790920606.618597:0:14962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790920606.618598:0:14962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790920606.618599:0:14962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920606.618600:0:14962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920606.618601:0:14962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920606.618602:0:14962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920606.618603:0:14962:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790920606.618605:0:14962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920606.618605:0:14962:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790920606.618914:0:14962:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790920606.618935:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236160:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790920606.618997:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.619089:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067b7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.619129:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236160 00000100:00100000:1.0:1790920606.619137:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236160 00000100:00100000:1.0:1790920606.619228:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790920606.619238:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14962:x1877915972236160:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790920606.619275:0:14275:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790920606.619278:0:14275:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790920606.619282:0:14275:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790920606.625477:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+12:14962:x1877915972236160:12345-0@lo:253:mount.lustre.0 Request processed in 6230us (6469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.625493:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790920606.625588:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236160:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790920606.625604:0:14962:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790920606.625607:0:14962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790920606.625609:0:14962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790920606.625623:0:14962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920606.625624:0:14962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920606.625625:0:14962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920606.625627:0:14962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920606.625628:0:14962:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790920606.625630:0:14962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920606.625631:0:14962:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790920606.625652:0:14962:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88eb3a4cd800 from lustre-OST0000 10000000:01000000:3.0:1790920606.625680:0:14962:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790920606.625683:0:14962:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790920606.625690:0:14962:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88eb066619c0 local copy 00010000:00010000:3.0:1790920606.625842:0:14962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920606.626131:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920606.626171:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.626257:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790920606.626306:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236288 00000100:00100000:2.0:1790920606.626313:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236288 00000100:00100000:2.0:1790920606.626399:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790920606.626418:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14962:x1877915972236288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920606.626584:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+12:14962:x1877915972236288:12345-0@lo:501:mount.lustre.0 Request processed in 167us (412us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790920606.626591:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790920606.626659:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236288:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790920606.626672:0:14962:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790920606.626868:0:14962:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790920606.626876:0:14962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.626886:0:14962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920606.626907:0:14962:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88eb3a4cd800 10000000:01000000:3.0:1790920606.626912:0:14962:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790920606.626917:0:14962:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88eb066619c0 10000000:01000000:3.0:1790920606.626919:0:14962:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790920606.626923:0:14962:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88eb066619c0 from 1 10000000:01000000:3.0:1790920606.626931:0:14962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790920606.626957:0:14962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e36400/0x2a4915844546b1fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.626966:0:14962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e36400/0x2a4915844546b1fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.626977:0:14962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e36400/0x2a4915844546b1fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920606.626990:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790920606.627036:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.627445:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.627529:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236416 00000100:00100000:1.0:1790920606.627535:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236416 00000100:00100000:1.0:1790920606.627562:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790920606.627570:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+12:14962:x1877915972236416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920606.627581:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920606.627597:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443ce00/0x2a4915844546b203 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b1fc expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.627619:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443ce00/0x2a4915844546b203 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b1fc expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.627642:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443ce00/0x2a4915844546b203 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b1fc expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.627650:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443ce00, rc 0) 00000100:00100000:1.0:1790920606.627858:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+13:14962:x1877915972236416:12345-0@lo:101:mount.lustre.0 Request processed in 288us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.627864:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790920606.628004:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790920606.628077:0:14962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e36400/0x2a4915844546b1fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b203 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.628087:0:14962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e36400/0x2a4915844546b1fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b203 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920606.628106:0:14962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790920606.628149:0:14962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e36400/0x2a4915844546b1fc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b203 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.628158:0:14962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e36400/0x2a4915844546b1fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b203 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920606.628165:0:14962:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790920606.628169:0:14962:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790920606.628180:0:14962:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790920606.628183:0:14962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790920606.628201:0:14962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37800/0x2a4915844546b20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.628208:0:14962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e37800/0x2a4915844546b20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.628216:0:14962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e37800/0x2a4915844546b20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920606.628230:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790920606.628256:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.628280:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.628328:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236544 00000100:00100000:1.0:1790920606.628332:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236544 00000100:00100000:1.0:1790920606.628359:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790920606.628365:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+13:14962:x1877915972236544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920606.628373:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920606.628381:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443de00/0x2a4915844546b211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b20a expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.628394:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443de00/0x2a4915844546b211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b20a expref: 14 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.628414:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443de00/0x2a4915844546b211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b20a expref: 14 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.628422:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443de00, rc 0) 00000100:00100000:1.0:1790920606.628458:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972236544:12345-0@lo:101:mount.lustre.0 Request processed in 93us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.628464:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790920606.628556:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790920606.628568:0:14962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e37800/0x2a4915844546b20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b211 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.628575:0:14962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37800/0x2a4915844546b20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b211 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920606.629381:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790920606.630379:0:14962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790920606.630617:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790920606.630661:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790920606.630696:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790920606.630853:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790920606.630909:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790920606.630941:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790920606.631015:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790920606.631024:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790920606.631109:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790920606.631174:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.631223:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.631383:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236672 00000100:00100000:1.0:1790920606.631389:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236672 00000100:00100000:1.0:1790920606.631459:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790920606.631468:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972236672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920606.631895:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972236672:12345-0@lo:501:mount.lustre.0 Request processed in 427us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.631904:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790920606.632153:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790920606.632192:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790920606.632230:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.632259:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920606.632381:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236800 00000100:00100000:3.0:1790920606.632387:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236800 00000100:00100000:3.0:1790920606.632422:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790920606.632430:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972236800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790920606.632988:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972236800:12345-0@lo:503:mount.lustre.0 Request processed in 557us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920606.632995:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790920606.633253:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236800:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790920606.634179:0:14962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790920606.634256:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790920606.634317:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.634426:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920606.634475:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972236928 00000100:00100000:3.0:1790920606.634481:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972236928 00000100:00100000:3.0:1790920606.634566:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790920606.634576:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972236928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790920606.635145:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972236928:12345-0@lo:502:mount.lustre.0 Request processed in 568us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920606.635154:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790920606.635271:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972236928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790920606.635525:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790920606.635575:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790920606.635608:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790920606.635654:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790920606.635692:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790920606.635876:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790920606.635925:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790920606.635953:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790920606.635978:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790920606.636154:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790920606.636207:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790920606.636255:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790920606.636294:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790920606.636350:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.636472:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790920606.636539:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237056 00000100:00100000:3.0:1790920606.636545:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237056 00000100:00100000:3.0:1790920606.636586:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790920606.636594:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972237056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790920606.637116:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790920606.637198:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790920606.637209:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000100:00100000:3.0:1790920606.638121:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972237056:12345-0@lo:502:mount.lustre.0 Request processed in 420us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920606.638135:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:01000000:0.0:1790920606.638388:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790920606.638395:0:14976:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1790920606.638401:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920606.638417:0:14976:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790920606.638423:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790920606.638436:0:14976:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88eb18013380) 00000020:00000080:0.0:1790920606.638454:0:14976:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790920606.638458:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790920606.638523:0:14976:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb3a4cd800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790920606.638853:0:14976:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790920606.638862:0:14976:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2a4915844546b21f 00010000:00010000:0.0:1790920606.644440:0:14976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1790920606.645371:0:14976:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1790920606.649259:0:14976:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790920606.651135:0:14976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790920606.651148:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920606.651155:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920606.651158:0:14976:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790920606.651164:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790920606.651167:0:14976:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790920606.651169:0:14976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790920606.651170:0:14976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790920606.651172:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790920606.651175:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920606.651177:0:14976:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790920606.651179:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920606.651182:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920606.651184:0:14976:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790920606.651186:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790920606.651188:0:14976:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790920606.651191:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920606.651193:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920606.651195:0:14976:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790920606.651197:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920606.651200:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920606.651202:0:14976:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790920606.651205:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790920606.651262:0:14976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920606.651265:0:14976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920606.651267:0:14976:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790920606.651270:0:14976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790920606.651444:0:14962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790920606.651469:0:14962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790920606.651495:0:14962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37800/0x2a4915844546b20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b211 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.651508:0:14962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e37800/0x2a4915844546b20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b211 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920606.651516:0:14962:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3a4cd800 from 1 10000000:01000000:0.0:1790920606.651519:0:14962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790920606.651563:0:14962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.651571:0:14962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.651591:0:14962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920606.651616:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790920606.651680:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.651712:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.651880:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237184 00000100:00100000:1.0:1790920606.651893:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237184 00000100:00100000:1.0:1790920606.651937:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790920606.651947:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+14:14962:x1877915972237184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920606.651961:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920606.651977:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b226 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.651999:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b226 expref: 15 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.652009:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b226 expref: 15 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920606.652016:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d800, rc 0) 00000100:00100000:1.0:1790920606.652072:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237184:12345-0@lo:101:mount.lustre.0 Request processed in 128us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.652078:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790920606.652157:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790920606.652174:0:14962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.652183:0:14962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920606.652687:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790920606.653070:0:14962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790920606.653304:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790920606.653346:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790920606.653418:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790920606.653427:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790920606.653487:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790920606.653532:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.653571:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920606.653950:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237312 00000100:00100000:3.0:1790920606.653958:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237312 00000100:00100000:3.0:1790920606.655688:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790920606.655707:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920606.656057:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237312:12345-0@lo:501:mount.lustre.0 Request processed in 355us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920606.656066:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790920606.656263:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920606.656322:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790920606.656369:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920606.659218:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb1818a240 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.659307:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237440 00000100:00100000:1.0:1790920606.659317:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237440 00000100:00100000:1.0:1790920606.659359:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790920606.659368:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790920606.659718:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237440:12345-0@lo:503:mount.lustre.0 Request processed in 350us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.659726:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790920606.659909:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790920606.660442:0:14962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790920606.660517:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790920606.660632:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920606.660713:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb1818a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790920606.660875:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237568 00000100:00100000:3.0:1790920606.660882:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237568 00000100:00100000:3.0:1790920606.660947:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790920606.660954:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790920606.661180:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237568:12345-0@lo:502:mount.lustre.0 Request processed in 224us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920606.661187:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790920606.661267:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790920606.661520:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790920606.661652:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790920606.661707:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790920606.661821:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790920606.661876:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790920606.661932:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790920606.661964:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790920606.661993:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790920606.662023:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790920606.662069:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920606.662139:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb1818a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790920606.662194:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237696 00000100:00100000:3.0:1790920606.662199:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237696 00000100:00100000:3.0:1790920606.662235:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790920606.662242:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790920606.662379:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237696:12345-0@lo:502:mount.lustre.0 Request processed in 137us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920606.662395:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790920606.662501:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790920606.662608:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790920606.662618:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1790920606.664039:0:14980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920606.664051:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920606.664053:0:14980:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790920606.664060:0:14980:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb3a4cd800 00000020:00000080:0.0:1790920606.664063:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790920606.664070:0:14980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920606.664080:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920606.664082:0:14980:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790920606.664086:0:14980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920606.664088:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920606.664089:0:14980:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790920606.664093:0:14980:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb3a4cd800 00000020:00000080:0.0:1790920606.664095:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790920606.664170:0:14980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920606.664174:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920606.664176:0:14980:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790920606.664179:0:14980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790920606.664182:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920606.664183:0:14980:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790920606.664187:0:14980:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88eb3a4cd800 00000020:00000080:0.0:1790920606.664189:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790920606.664226:0:14980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790920606.664229:0:14980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790920606.664230:0:14980:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790920606.664235:0:14980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790920606.667771:0:14962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790920606.667820:0:14962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790920606.667840:0:14962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.667854:0:14962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920606.667903:0:14962:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790920606.667908:0:14962:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88eb3a4cd800 10000000:01000000:3.0:1790920606.667911:0:14962:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88eb3a4cd800 10000000:01000000:3.0:1790920606.667915:0:14962:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790920606.667921:0:14962:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb3a4cd800 from 1 10000000:01000000:3.0:1790920606.667923:0:14962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790920606.667962:0:14962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e36200/0x2a4915844546b234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.667970:0:14962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e36200/0x2a4915844546b234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.667982:0:14962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e36200/0x2a4915844546b234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920606.668008:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790920606.668078:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.668126:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237824 00000100:00100000:3.0:1790920606.668133:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237824 00000100:00100000:3.0:1790920606.668177:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790920606.668191:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972237824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790920606.668204:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920606.668216:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e37c00/0x2a4915844546b23b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b234 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.668238:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e37c00/0x2a4915844546b23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b234 expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.668247:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e37c00/0x2a4915844546b23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b234 expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.668255:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37c00, rc 0) 00000100:00100000:3.0:1790920606.668287:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972237824:12345-0@lo:101:mount.lustre.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920606.668295:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790920606.668348:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a46c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790920606.668370:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790920606.668383:0:14962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e36200/0x2a4915844546b234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b23b expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920606.668392:0:14962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e36200/0x2a4915844546b234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b23b expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790920606.669253:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1790920606.670079:0:14962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790920606.670368:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790920606.670427:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790920606.670463:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790920606.670511:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790920606.671019:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790920606.671073:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790920606.671114:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790920606.671145:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790920606.671195:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790920606.671229:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790920606.671259:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790920606.671298:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790920606.671327:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790920606.671355:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790920606.671393:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790920606.671459:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790920606.671492:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790920606.671635:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790920606.671677:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790920606.671711:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790920606.671831:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790920606.671870:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790920606.671899:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790920606.671941:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790920606.671971:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790920606.671999:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790920606.672046:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790920606.672084:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790920606.672167:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790920606.672175:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1790920606.672280:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920606.672351:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.672470:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a46c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.672606:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972237952 00000100:00100000:1.0:1790920606.672613:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972237952 00000100:00100000:1.0:1790920606.672660:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790920606.672668:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972237952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920606.673001:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972237952:12345-0@lo:501:mount.lustre.0 Request processed in 332us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.673008:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790920606.673471:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972237952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920606.673510:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790920606.673632:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.673666:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a46c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920606.673726:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238080 00000100:00100000:2.0:1790920606.673731:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238080 00000100:00100000:2.0:1790920606.673783:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790920606.673791:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972238080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790920606.673938:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972238080:12345-0@lo:503:mount.lustre.0 Request processed in 148us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920606.673946:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790920606.674028:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790920606.676197:0:14962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790920606.676324:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790920606.676444:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.676504:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a46c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790920606.676827:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238208 00000100:00100000:1.0:1790920606.676835:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238208 00000100:00100000:1.0:1790920606.676916:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790920606.676925:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972238208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790920606.677173:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972238208:12345-0@lo:502:mount.lustre.0 Request processed in 248us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.677182:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790920606.677283:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790920606.677629:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790920606.677681:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790920606.677713:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790920606.677784:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790920606.677823:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790920606.677873:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790920606.677909:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790920606.677941:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790920606.677988:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790920606.678024:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790920606.678059:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790920606.678110:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790920606.678147:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790920606.678179:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790920606.678824:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790920606.678878:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790920606.678908:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790920606.678951:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790920606.678981:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790920606.679010:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790920606.679057:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790920606.679103:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790920606.679135:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790920606.679193:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790920606.679223:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790920606.679251:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790920606.679287:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790920606.679315:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790920606.679344:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790920606.679386:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790920606.679436:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790920606.679487:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790920606.679524:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790920606.679652:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790920606.679690:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790920606.679737:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790920606.679800:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790920606.679832:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790920606.679889:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790920606.679928:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790920606.679982:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790920606.680059:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920606.681521:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238336 00000100:00100000:2.0:1790920606.681534:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238336 00000100:00100000:2.0:1790920606.681575:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790920606.681584:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972238336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790920606.681918:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972238336:12345-0@lo:502:mount.lustre.0 Request processed in 334us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920606.681927:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790920606.682865:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a46c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920606.682907:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790920606.683044:0:14962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790920606.683060:0:14962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790920606.684839:0:14984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790920606.684854:0:14984:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88eb41fecd40) 00000020:00000080:1.0:1790920606.684873:0:14984:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1790920606.684946:0:14984:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb3a4cd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790920606.684950:0:14984:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb3a4cd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790920606.684952:0:14984:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb3a4cd800 3 00010000:00080000:1.0:1790920606.684983:0:14984:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88eb18763800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1790920606.689230:0:14984:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1790920606.689505:0:14984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790920606.689566:0:14984:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790920606.689581:0:14984:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2a4915844546b249 00000100:00080000:1.0:1790920606.689591:0:14984:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790920606.689603:0:14984:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88eb18763800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1790920606.689640:0:14984:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f656d80 x1877915972238464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790920606.689663:0:14984:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790920606.689689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790920606.689699:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790920606.689702:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790920606.689705:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790920606.689773:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972238592:0@lo:400:kworker.0 00000100:00100000:1.0:1790920606.689840:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920606.689927:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238592 00000100:00100000:1.0:1790920606.689933:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238592 00000100:00100000:1.0:1790920606.689990:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920606.689999:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972238592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920606.690051:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972238592:12345-0@lo:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.690057:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790920606.690096:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88eb3f657800 x1877915972238592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920606.690109:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972238592:0@lo:400:kworker.0 00000040:00080000:1.0:1790920606.690358:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1790920606.690643:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1877915972238464:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790920606.690694:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920606.690836:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238464 00000100:00100000:1.0:1790920606.690842:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238464 00000100:00100000:1.0:1790920606.690876:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920606.690881:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877915972238464:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790920606.690904:0:14282:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1790920606.690958:0:14282:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2a4915844546b250 00000004:00100000:1.0:1790920606.690974:0:14282:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790920606.691003:0:14282:0:(import.c:65:import_set_state_nolock()) ffff88eb0e91f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790920606.691059:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877915972238464:12345-0@lo:38:llog_process_th.0 Request processed in 176us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920606.691067:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790920606.691116:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88eb3f656d80 x1877915972238464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790920616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920606.691125:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790920606.691132:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1790920606.691139:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790920606.691144:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790920606.691146:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb18763800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790920606.691152:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1877915972238464:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1790920606.694381:0:14962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790920606.694442:0:14962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790920606.694460:0:14962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e36200/0x2a4915844546b234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b23b expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920606.694473:0:14962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e36200/0x2a4915844546b234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b23b expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790920606.694530:0:14962:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790920606.694533:0:14962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790920606.694534:0:14962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920606.694535:0:14962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920606.694537:0:14962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920606.694538:0:14962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920606.694539:0:14962:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920606.694541:0:14962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920606.694542:0:14962:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790920606.694546:0:14962:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790920606.694548:0:14962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790920606.694549:0:14962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790920606.694550:0:14962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920606.694551:0:14962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920606.694552:0:14962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920606.694553:0:14962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920606.694554:0:14962:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920606.694555:0:14962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920606.694556:0:14962:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790920606.694582:0:14962:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790920606.694605:0:14962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790920606.694670:0:14962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920606.694794:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238720 00000100:00100000:3.0:1790920606.694802:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238720 00000100:00100000:3.0:1790920606.694844:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790920606.694852:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:14962:x1877915972238720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790920606.694876:0:14273:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790920606.694890:0:14273:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790920606.698061:0:14962:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb420fa540 going to sleep for 11 seconds 20000000:01000000:2.0:1790920606.741734:0:14273:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790920606.741776:0:14273:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790920606.741846:0:14296:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790920606.741851:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790920606.741874:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.741893:0:14296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b1bd expref: 16 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.741902:0:14296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.741941:0:14296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546b1bd expref: 16 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.741979:0:14296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546b1bd expref: 16 pid: 14275 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920606.741995:0:14296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14296:1877915972238848:0@lo:104: 00000100:00100000:0.0:1790920606.742070:0:14296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.742130:0:14296:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb071f4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920606.744056:0:14263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238848 00000100:00100000:2.0:1790920606.744070:0:14263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238848 00000100:00100000:2.0:1790920606.744233:0:14263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790920606.744244:0:14263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b6dbfc26-a70a-426c-a856-613d861b9981+3:14296:x1877915972238848:12345-0@lo:104: 00010000:00010000:2.0:1790920606.744262:0:14263:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920606.744348:0:14263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790920606.744354:0:14263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b6dbfc26-a70a-426c-a856-613d861b9981+3:14296:x1877915972238848:12345-0@lo:104: Request processed in 113us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920606.744361:0:14263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790920606.744383:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920606.744388:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920606.744396:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c200 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:2.0:1790920606.744412:0:14269:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920606.744422:0:14269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790920606.744430:0:14269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920606.744436:0:14269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790920606.744474:0:14269:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920606.744497:0:14269:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790920606.744519:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920606.744526:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb3443c200/0x2a4915844546b1bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b1c4 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920606.744546:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920606.744548:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920606.744550:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920606.744658:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972238976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920606.744708:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920606.744784:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972238976 00000100:00100000:0.0:1790920606.744789:0:14267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972238976 00010000:00010000:0.0:1790920606.744809:0:14267:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b1bd expref: 17 pid: 14275 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920606.744827:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790920606.744833:0:14267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6dbfc26-a70a-426c-a856-613d861b9981+17:3304:x1877915972238976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920606.744845:0:14267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920606.744850:0:14267:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b1bd expref: 17 pid: 14275 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744861:0:14267:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546b1bd expref: 17 pid: 14275 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744878:0:14267:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744887:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790920606.744914:0:14267:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003063751s 00010000:00010000:0.0:1790920606.744920:0:14267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744928:0:14267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744934:0:14267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744940:0:14267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744947:0:14267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920606.744951:0:14267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744960:0:14267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744968:0:14267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.744979:0:14267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920606.745011:0:14267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6dbfc26-a70a-426c-a856-613d861b9981+17:3304:x1877915972238976:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920606.745426:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790920606.745472:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972238976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920606.745499:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3f56b600/0x2a4915844546b1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546b1bd expref: 16 pid: 14275 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920606.745518:0:14296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14296:1877915972238848:0@lo:104: 00010000:00010000:0.0:1790920606.745713:0:14296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.745722:0:14296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.745728:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920606.745734:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3ae52c00/0x2a4915844546b257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920606.752259:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+15:14962:x1877915972238720:12345-0@lo:253:mount.lustre.0 Request processed in 57398us (57579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920606.752274:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790920606.752454:0:14962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:14962:1877915972238720:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790920606.752473:0:14962:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790920606.752476:0:14962:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790920606.752478:0:14962:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790920606.752479:0:14962:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790920606.752480:0:14962:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790920606.752481:0:14962:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790920606.752482:0:14962:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790920606.752483:0:14962:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790920606.752485:0:14962:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790920606.752486:0:14962:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790920606.752501:0:14962:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790920606.757059:0:14962:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920606.757257:0:14962:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790920606.757425:0:14962:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920606.757587:0:14962:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790920606.757778:0:14962:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790920606.758013:0:14962:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790920606.759372:0:14962:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790920606.803817:0:14962:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790920606.803826:0:14962:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790920606.803854:0:14962:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790920606.803910:0:14962:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790920606.803930:0:14962:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790920606.803957:0:14962:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1790920607.465032:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790920607.913169:0:14277:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790920607.913179:0:14277:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb3f5e5000 from 7 10000000:01000000:3.0:1790920607.913185:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790920607.913239:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920607.913252:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920607.913264:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920607.913290:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972239104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920607.913360:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920607.913415:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920607.913436:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972239104 00000100:00100000:3.0:1790920607.913443:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972239104 00000100:00100000:3.0:1790920607.913493:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790920607.913502:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+15:14277:x1877915972239104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920607.913513:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920607.913525:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b25e expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920607.913546:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b25e expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920607.913556:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b25e expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920607.913564:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36c00, rc 0) 00000100:00100000:3.0:1790920607.913599:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+16:14277:x1877915972239104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920607.913605:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790920607.913653:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972239104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920607.913666:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920607.913673:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920607.913716:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972239232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790920607.913743:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920607.916938:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb09a466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790920607.916977:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972239232 00000100:00100000:3.0:1790920607.916987:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972239232 00000100:00100000:3.0:1790920607.917041:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790920607.917050:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:14277:x1877915972239232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790920607.917076:0:14273:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790920607.917097:0:14273:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790920607.917101:0:14273:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790920607.917215:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:14277:x1877915972239232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 165us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920607.917224:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790920607.917276:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972239232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790920607.917340:0:14277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790920607.917351:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920607.917362:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920608.499315:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920609.515307:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920610.538250:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920611.564287:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790920611.950348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790920611.950356:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790920611.950358:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790920611.950361:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790920611.950403:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920611.950424:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972239360:0@lo:400:kworker.0 00000100:00100000:0.0:1790920611.950496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920611.950562:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972239488:0@lo:400:kworker.0 00000100:00100000:1.0:1790920611.950566:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972239360 00000100:00100000:1.0:1790920611.950575:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972239360 00000100:00100000:1.0:1790920611.950623:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790920611.950633:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:3304:x1877915972239360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920611.950776:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:3304:x1877915972239360:12345-0@lo:400:kworker.0 Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920611.950862:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790920611.950930:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920611.950965:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920611.950971:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972239616:0@lo:400:kworker.0 00000100:00100000:0.0:1790920611.950995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920611.951422:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972239360:0@lo:400:kworker.0 00000100:00100000:2.0:1790920611.953719:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972239488 00000100:00100000:2.0:1790920611.953733:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972239488 00000100:00100000:2.0:1790920611.953805:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972239616 00000100:00100000:2.0:1790920611.954295:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972239616 00000100:00100000:2.0:1790920611.954415:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790920611.954425:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972239488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920611.954588:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972239488:12345-0@lo:400:kworker.0 Request processed in 102us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920611.954606:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790920611.954625:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790920611.954631:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972239616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920611.954663:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972239616:12345-0@lo:400:kworker.0 Request processed in 33us (3667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920611.954669:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790920611.954725:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb4189d880 x1877915972239616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920611.954739:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972239616:0@lo:400:kworker.0 00010000:00080000:2.0:1790920611.954777:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb4189e300 x1877915972239488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920611.954787:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972239488:0@lo:400:kworker.0 00000100:00080000:1.0:1790920611.956084:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790920612.585353:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790920613.120958:0:15329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790920613.612606:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920614.633098:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790920615.018252:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790920615.657129:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920616.681039:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790920617.065073:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790920617.065081:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790920617.065084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790920617.065088:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790920617.065164:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972239744:0@lo:400:kworker.0 00000100:00100000:0.0:1790920617.065259:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920617.065322:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920617.065329:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972239872:0@lo:400:kworker.0 00000100:00100000:0.0:1790920617.065355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920617.065384:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972240000:0@lo:400:kworker.0 00000100:00100000:0.0:1790920617.065407:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920617.065437:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972239744 00000100:00100000:0.0:1790920617.065445:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972239744 00000100:00100000:0.0:1790920617.065488:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790920617.065496:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:3304:x1877915972239744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920617.065545:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:3304:x1877915972239744:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920617.065552:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790920617.065598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972239744:0@lo:400:kworker.0 00000100:00100000:2.0:1790920617.065840:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972239872 00000100:00100000:2.0:1790920617.065845:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972239872 00000100:00100000:2.0:1790920617.065871:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240000 00000100:00100000:2.0:1790920617.065873:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240000 00000100:00100000:2.0:1790920617.065898:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920617.065904:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972239872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920617.065949:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972239872:12345-0@lo:400:kworker.0 Request processed in 45us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920617.065955:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920617.065977:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920617.065983:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972240000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920617.066018:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972240000:12345-0@lo:400:kworker.0 Request processed in 34us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920617.066024:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790920617.066055:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb4189d180 x1877915972240000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920617.066067:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972240000:0@lo:400:kworker.0 00010000:00080000:2.0:1790920617.066091:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb4189e680 x1877915972239872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920617.066099:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972239872:0@lo:400:kworker.0 00000100:00080000:2.0:1790920617.066121:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790920617.706889:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920617.963936:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790920602/real 1790920602] req@ffff88eb3f573100 x1877915972235520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920617.963969:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88eb3f573100 x1877915972235520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920617.963981:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790920602/real 1790920602] req@ffff88eb3f570a80 x1877915972235648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920617.963993:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88eb3f570a80 x1877915972235648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790920617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790920617.964013:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f668800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790920617.964821:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790920617.964828:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972235520:0@lo:8:kworker.0 00000100:00080000:0.0:1790920617.964835:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790920617.971825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790920617.971832:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790920617.971836:0:37:0:(import.c:65:import_set_state_nolock()) ffff88eb3f668800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790920617.971844:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:3.0:1790920617.971850:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790920617.971863:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88eb3f668800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:3.0:1790920617.971888:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb33f70380 x1877915972240256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790920617.971903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790920617.971906:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790920617.971908:0:37:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790920617.971911:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:3.0:1790920617.971914:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790920617.971918:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88eb09b00000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:3.0:1790920617.971929:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb33f72300 x1877915972240384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790920617.971978:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790920617.971995:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972240128:0@lo:400:kworker.0 00000100:00100000:3.0:1790920617.972082:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920617.972139:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972240512:0@lo:400:kworker.0 00000100:00100000:3.0:1790920617.972169:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920617.972203:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920617.972209:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972240640:0@lo:400:kworker.0 00000100:00100000:3.0:1790920617.972246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920617.972282:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240128 00000100:00100000:3.0:1790920617.972289:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240128 00000100:00100000:3.0:1790920617.972334:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790920617.972343:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+16:3306:x1877915972240128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920617.972385:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+16:3306:x1877915972240128:12345-0@lo:400:kworker.0 Request processed in 44us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920617.972392:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790920617.972426:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240512 00000100:00100000:3.0:1790920617.972429:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240512 00000100:00100000:3.0:1790920617.972454:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240640 00000100:00100000:3.0:1790920617.972457:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240640 00000100:00100000:3.0:1790920617.972473:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790920617.972479:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972240512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920617.972515:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972240512:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920617.972521:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790920617.972533:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790920617.972540:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972240640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920617.972566:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972240640:12345-0@lo:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920617.972571:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790920617.972607:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb33f72680 x1877915972240640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920617.972620:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972240640:0@lo:400:kworker.0 00010000:00080000:3.0:1790920617.972629:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb33f71f80 x1877915972240512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790920617.972642:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972240512:0@lo:400:kworker.0 00000100:00100000:3.0:1790920617.972665:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972240128:0@lo:400:kworker.0 00000100:00080000:0.0:1790920617.976981:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790920617.976994:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972235648:0@lo:8:kworker.0 00000100:00100000:0.0:1790920617.977129:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972240256:0@lo:8:kworker.0 00000100:00100000:0.0:1790920617.977218:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920617.978968:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972240384:0@lo:8:kworker.0 00000100:00100000:0.0:1790920617.979033:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920617.993894:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240256 00000100:00100000:1.0:1790920617.993912:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240256 00000100:00100000:1.0:1790920617.993971:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240384 00000100:00100000:1.0:1790920617.993974:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240384 00000100:00100000:1.0:1790920617.993990:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920617.993998:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1877915972240256:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790920617.994145:0:14963:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:1.0:1790920617.994173:0:14963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a4915844546b26c 00002000:00100000:1.0:1790920617.994211:0:14963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88eb3f9ae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790920617.994215:0:14963:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790920617.994218:0:14963:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790920617.994558:0:14963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790920617.994585:0:14963:0:(import.c:65:import_set_state_nolock()) ffff88eb3f9aa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790920617.994679:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1877915972240256:12345-0@lo:8:kworker.0 Request processed in 680us (17461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920617.994687:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920617.994706:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920617.994710:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1877915972240384:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790920617.994721:0:14963:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790920617.994768:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1877915972240384:12345-0@lo:8:kworker.0 Request processed in 35us (15714us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790920617.994773:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790920617.994898:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb33f70380 x1877915972240256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790920637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920617.994908:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790920617.994917:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790920617.994926:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790920617.994931:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790920617.994933:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb3f668800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790920617.994944:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790920617.994950:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972240256:0@lo:8:kworker.0 00000100:00080000:1.0:1790920617.994967:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790920617.994971:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790920617.994975:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972240384:0@lo:8:kworker.0 00000004:00080000:2.0:1790920617.995179:0:14303:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1790920617.995216:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f570000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14303:1877915972240896:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790920617.995255:0:14303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920617.995278:0:14303:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f51480 going to sleep for 11 seconds 00000004:00080000:2.0:1790920617.995295:0:14302:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790920617.995532:0:14302:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460161784208ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790920617.995559:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972240768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920617.995588:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920617.995640:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240896 00000100:00100000:2.0:1790920617.995646:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240896 00000100:00100000:2.0:1790920617.995687:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790920617.995695:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14303:x1877915972240896:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790920617.995951:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972240768 00000100:00100000:1.0:1790920617.995956:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972240768 00000100:00100000:1.0:1790920617.995982:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920617.995989:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877915972240768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790920617.996014:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920617.996967:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1877915972240768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 977us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920617.996975:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790920618.001170:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790920618.004987:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3f572300 x1877915972240768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920618.005923:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972240768:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1790920618.021373:0:14963:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790920618.021388:0:14963:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1790920618.021394:0:14963:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1790920618.042665:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920618.042679:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.042699:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=460s v=(0 0) 00010000:00010000:2.0:1790920618.042705:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920618.042712:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.042730:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.042742:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.046277:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.046316:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920618.046333:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920618.046351:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.046361:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.046367:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.046379:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.046401:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.046409:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d397646/0x2a4915844546b273 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.046430:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.046432:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.046434:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790920618.048486:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1790920618.054226:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920618.054242:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054261:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=460s v=(0 0) 00010000:00010000:2.0:1790920618.054266:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920618.054273:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054305:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054317:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054326:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054351:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920618.054370:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920618.054375:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054384:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.054388:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054397:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054414:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054422:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cdf6cc3/0x2a4915844546b27a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.054448:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.054450:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.054452:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920618.056123:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920618.056136:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056151:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=460s v=(0 0) 00010000:00010000:2.0:1790920618.056156:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920618.056162:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056174:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056193:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056202:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056228:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790920618.056685:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920618.056692:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056714:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=460s v=(0 0) 00010000:00010000:2.0:1790920618.056717:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920618.056721:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056729:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056737:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056778:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.056937:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790920618.059966:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790920618.059981:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.059997:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920618.060001:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060024:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060055:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060063:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004496bfad/0x2a4915844546b281 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060085:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920618.060101:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060108:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56aa00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920618.060112:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060119:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060130:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060138:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efcecba/0x2a4915844546b288 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.060152:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.060154:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.060156:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.062650:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.062662:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.062679:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.062684:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.062690:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.062706:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.062716:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.062725:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.062783:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790920618.062961:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920618.062969:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.062977:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920618.062981:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.063003:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.063030:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.063038:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4cdbf9/0x2a4915844546b28f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.063058:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.063060:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.063062:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.064459:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.064469:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.064489:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.064493:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.064499:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.064511:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.064520:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.064528:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.064551:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790920618.064637:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920618.064644:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.064653:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920618.064657:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.064666:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.064679:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.064698:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e37fd983/0x2a4915844546b296 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.064714:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.064716:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.064718:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.065667:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.065677:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.065689:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.065693:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.065698:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.065709:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.065728:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.065735:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.065930:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790920618.066400:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.066406:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.066416:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.066420:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.066424:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.066434:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.066442:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.066450:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.066470:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790920618.067046:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790920618.067055:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067063:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.067068:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067077:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067105:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067112:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c92604d/0x2a4915844546b29d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067128:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920618.067131:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067138:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.067141:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067148:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067156:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067163:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b1d23c7/0x2a4915844546b2a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.067173:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.067174:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.067180:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.067661:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.067668:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.067678:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.067682:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.067686:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.067695:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.067703:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.067710:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.067732:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790920618.068484:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.068491:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.068501:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.068513:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.068519:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.068529:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.068538:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.068546:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.068555:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790920618.068934:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790920618.068942:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.068951:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.068955:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.068965:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.068981:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.068989:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091f02349/0x2a4915844546b2ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.069007:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920618.069011:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.069030:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37a00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.069033:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.069041:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.069059:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.069067:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ab0c349/0x2a4915844546b2b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.069080:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.069082:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.069083:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.076008:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.076136:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.076154:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.076159:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.076165:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.076180:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.076325:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.076344:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.076380:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790920618.076546:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920618.076554:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.076562:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36a00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920618.076566:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.076574:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.076590:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.076597:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c620eed2/0x2a4915844546b2b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.076618:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.076619:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.076621:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.076926:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.077543:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.077551:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.077562:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.077567:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.077571:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.077582:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.077590:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.077597:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.077621:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790920618.077816:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790920618.077822:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.077830:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a52000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920618.077834:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.077843:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.077858:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.077865:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000769663ae/0x2a4915844546b2c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920618.077883:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.077884:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920618.077886:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.078898:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.078908:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.078929:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.078934:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.078939:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.078951:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.078960:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.078967:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.078990:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920618.079025:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.079032:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.079040:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a52200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.079044:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.079052:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.079070:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.079078:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3389c3/0x2a4915844546b2c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.079107:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.079109:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.079111:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.096915:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.096932:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.096949:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.096953:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.096960:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.096976:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097005:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097513:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097541:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920618.097557:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920618.097565:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097572:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920618.097576:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097584:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097602:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097609:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6287dc8/0x2a4915844546b2ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.097633:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920618.097640:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920618.097643:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790920618.101917:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790920618.101931:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.101948:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1790920618.101953:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920618.101959:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.101972:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.101982:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.101989:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.102009:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920618.102211:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.102219:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.102227:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.102231:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.102240:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.102257:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.102267:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.102268:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.102270:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920618.102316:0:14963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f0ec8e3/0x2a4915844546b2d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790920618.104710:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.104722:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.104738:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.104763:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.104778:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.104792:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.104802:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.104810:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.104832:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790920618.105216:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.105222:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105231:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.105234:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.105237:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105246:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105254:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105272:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105291:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790920618.105304:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920618.105310:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105318:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.105322:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105332:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105348:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105355:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335af7a2/0x2a4915844546b2dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105372:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.105376:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105392:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.105396:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105403:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105415:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105423:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021dd1f04/0x2a4915844546b2e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105436:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.105438:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.105440:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.105833:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.105839:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105849:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.105853:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.105857:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105867:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105881:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105889:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105902:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920618.105910:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.105914:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105921:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.105925:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105933:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105945:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105952:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b66324f/0x2a4915844546b2ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.105965:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.105971:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.105973:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.106369:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.106375:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106384:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.106388:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.106392:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106402:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106411:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106418:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106432:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920618.106440:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.106444:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106450:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.106453:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106471:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106482:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106489:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030a2cbe0/0x2a4915844546b2f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.106500:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.106502:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.106504:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920618.106505:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.108571:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.108585:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108601:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.108606:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.108612:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108625:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108635:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108659:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108682:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920618.108697:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.108703:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108711:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53a00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.108715:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108725:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108741:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108766:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076d6e60c/0x2a4915844546b2f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.108785:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.108787:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.108788:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.110887:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.110910:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.110926:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.110930:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.110937:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.110951:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.110962:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.110971:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.110993:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920618.111402:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920618.111411:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.111430:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920618.111435:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.111445:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.111462:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.111468:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8e184b8/0x2a4915844546b2ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920618.111486:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920618.111488:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920618.111490:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.115372:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.115387:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115406:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.115411:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.115467:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115485:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115503:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115512:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115530:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920618.115543:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.115549:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115556:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.115561:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115569:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115587:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115594:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b3285cd/0x2a4915844546b306 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.115613:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.115620:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.115622:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.116177:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.116197:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116206:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.116209:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.116215:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116225:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116234:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116241:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116263:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790920618.116844:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.116851:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116861:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.116864:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.116868:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116884:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116892:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116899:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116915:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790920618.116928:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920618.116934:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116941:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53400 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.116945:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116952:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116965:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116973:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d68217a9/0x2a4915844546b30d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.116995:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920618.116998:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117005:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920618.117009:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117018:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117028:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117034:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000978cdd1e/0x2a4915844546b314 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117045:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.117047:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920618.117048:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.117130:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.117597:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.117605:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117615:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.117618:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.117629:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117640:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117649:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117657:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.117682:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920618.117788:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920618.117875:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.117884:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.117888:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.117896:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.117909:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.117916:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9f2e371/0x2a4915844546b31b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.117941:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.117943:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.117945:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.118112:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.118117:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118125:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.118129:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.118133:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118142:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118150:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118166:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118195:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920618.118334:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920618.118339:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.118347:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53800 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.118350:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.118358:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.118369:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.118376:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000041b648a/0x2a4915844546b322 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.118462:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.118464:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.118466:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790920618.118808:0:14963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790920618.118814:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118822:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1790920618.118826:0:14963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920618.118829:0:14963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118839:0:14963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118848:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118856:0:14963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920618.118872:0:14963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790920618.119092:0:14963:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1790920618.119201:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14303:x1877915972240896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123502us (123941us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920618.119222:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790920618.120026:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f570000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14303:1877915972240896:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790920618.120043:0:14303:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1790920618.120101:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f570000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14303:1877915972241024:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790920618.120145:0:14303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920618.120204:0:14303:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05f51480 going to sleep for 11 seconds 00010000:00010000:2.0:1790920618.120231:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920618.120239:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.120249:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52800 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920618.120254:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.120265:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.120282:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.120290:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dd788ee/0x2a4915844546b329 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920618.120308:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.120310:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920618.120312:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920618.121890:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241024 00000100:00100000:2.0:1790920618.121901:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241024 00000100:00100000:2.0:1790920618.121955:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790920618.121964:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14303:x1877915972241024:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790920618.122039:0:14965:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1790920618.132573:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14303:x1877915972241024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10597us (12416us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790920618.132590:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790920618.134616:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f570000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14303:1877915972241024:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790920618.134636:0:14303:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1790920618.731614:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920619.760957:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920620.777481:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790920621.470501:0:15678:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790920621.470505:0:15678:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790920621.470642:0:15678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88eb32dc3800 00000020:01000004:2.0:1790920621.470658:0:15678:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790920621.470672:0:15678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790920621.470694:0:15678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88ea01f299c0) 00000020:00000080:2.0:1790920621.470713:0:15678:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790920621.519739:0:15678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790920621.520537:0:15678:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790920621.523957:0:15678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790920621.525723:0:15678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790920621.527456:0:15678:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790920621.529432:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 105: rc = 0 00100000:10000000:3.0:1790920621.529601:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 105: rc = 0 00100000:10000000:3.0:1790920621.529698:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 105: rc = 0 00100000:10000000:1.0:1790920621.555945:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 631: rc = 0 00100000:10000000:1.0:1790920621.556490:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 631: rc = 0 00100000:10000000:1.0:1790920621.556919:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 631: rc = 0 00100000:10000000:1.0:1790920621.559131:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 631: rc = 0 00100000:10000000:1.0:1790920621.563057:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 631: rc = 0 00100000:10000000:1.0:1790920621.565660:0:15678:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 631: rc = 0 00000020:00000080:1.0:1790920621.568997:0:15678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790920621.569019:0:15678:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790920621.569032:0:15678:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2a4915844546b337 00000020:01000004:1.0:1790920621.569041:0:15678:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1790920621.569062:0:15678:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790920621.569066:0:15678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790920621.569073:0:15678:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790920621.569094:0:15678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1790920621.569098:0:15678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790920621.600543:0:15678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790920621.600586:0:15678:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.134@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790920621.600591:0:15678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790920621.600593:0:15678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790920621.600594:0:15678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920621.600595:0:15678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920621.600596:0:15678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920621.600597:0:15678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920621.600599:0:15678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790920621.600601:0:15678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920621.600602:0:15678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790920621.600605:0:15678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790920621.600607:0:15678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790920621.600608:0:15678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790920621.600609:0:15678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920621.600610:0:15678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920621.600611:0:15678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920621.600612:0:15678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920621.600613:0:15678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790920621.600614:0:15678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920621.600615:0:15678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790920621.600643:0:15678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790920621.600664:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790920621.600909:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920621.601016:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0db446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920621.601219:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241152 00000100:00100000:0.0:1790920621.601228:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241152 00000100:00100000:0.0:1790920621.601322:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790920621.601331:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:15678:x1877915972241152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790920621.601361:0:14273:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790920621.601365:0:14273:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790920621.601368:0:14273:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790920621.608987:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:15678:x1877915972241152:12345-0@lo:253:mount.lustre.0 Request processed in 7649us (8070us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920621.609001:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790920621.609130:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790920621.609155:0:15678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790920621.609159:0:15678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790920621.609161:0:15678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790920621.609162:0:15678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790920621.609164:0:15678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790920621.609165:0:15678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790920621.609166:0:15678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790920621.609168:0:15678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790920621.609169:0:15678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790920621.609171:0:15678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790920621.609192:0:15678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88eb32dc3800 from lustre-OST0001 10000000:01000000:2.0:1790920621.609217:0:15678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790920621.609221:0:15678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790920621.609228:0:15678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88eb066619c0 local copy 00010000:00010000:2.0:1790920621.609240:0:15678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920621.609474:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920621.609508:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.609545:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920621.609773:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241280 00000100:00100000:1.0:1790920621.609780:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241280 00000100:00100000:1.0:1790920621.609814:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790920621.609822:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:15678:x1877915972241280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920621.609972:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+16:15678:x1877915972241280:12345-0@lo:501:mount.lustre.0 Request processed in 149us (463us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790920621.609980:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790920621.610439:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241280:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790920621.610463:0:15678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790920621.610588:0:15678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790920621.610596:0:15678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920621.610605:0:15678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56b400/0x2a4915844546b0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b0eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920621.610631:0:15678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88eb32dc3800 10000000:01000000:2.0:1790920621.610635:0:15678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790920621.610640:0:15678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790920621.610642:0:15678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790920621.610645:0:15678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790920621.610648:0:15678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790920621.610669:0:15678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a800/0x2a4915844546b33e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920621.610676:0:15678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a800/0x2a4915844546b33e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920621.610685:0:15678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a800/0x2a4915844546b33e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920621.610698:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790920621.610739:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.610783:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920621.610848:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241408 00000100:00100000:1.0:1790920621.610853:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241408 00000100:00100000:1.0:1790920621.610875:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790920621.610881:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+16:15678:x1877915972241408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920621.610890:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920621.610903:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443c400/0x2a4915844546b345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b33e expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920621.610923:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443c400/0x2a4915844546b345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b33e expref: 17 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920621.610946:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443c400/0x2a4915844546b345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b33e expref: 17 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920621.610954:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c400, rc 0) 00000100:00100000:1.0:1790920621.610994:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241408:12345-0@lo:101:mount.lustre.0 Request processed in 112us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920621.611000:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790920621.611270:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790920621.611283:0:15678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a800/0x2a4915844546b33e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b345 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920621.611299:0:15678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a800/0x2a4915844546b33e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b345 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790920621.611893:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790920621.613591:0:15678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790920621.616659:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790920621.616963:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790920621.616999:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790920621.619899:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790920621.619952:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790920621.619980:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790920621.620052:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790920621.620061:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790920621.620693:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920621.621437:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.621529:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a180 going to sleep for 11 seconds 00000100:00100000:3.0:1790920621.622053:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241536 00000100:00100000:3.0:1790920621.622062:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241536 00000100:00100000:3.0:1790920621.622286:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790920621.622297:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920621.622735:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241536:12345-0@lo:501:mount.lustre.0 Request processed in 440us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920621.622743:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790920621.623263:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920621.623463:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790920621.623529:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.623564:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a180 going to sleep for 11 seconds 00000100:00100000:0.0:1790920621.623680:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241664 00000100:00100000:0.0:1790920621.623687:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241664 00000100:00100000:0.0:1790920621.623739:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790920621.623773:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790920621.624106:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241664:12345-0@lo:503:mount.lustre.0 Request processed in 359us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.624125:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790920621.624446:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241664:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790920621.626469:0:15678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790920621.626659:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790920621.630043:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.630100:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a180 going to sleep for 11 seconds 00000100:00100000:0.0:1790920621.630415:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241792 00000100:00100000:0.0:1790920621.630426:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241792 00000100:00100000:0.0:1790920621.630485:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790920621.630493:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790920621.630812:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241792:12345-0@lo:502:mount.lustre.0 Request processed in 319us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.630821:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790920621.630990:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790920621.631480:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790920621.631538:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790920621.631573:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790920621.631622:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790920621.631659:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790920621.631690:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790920621.632052:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790920621.632254:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790920621.632314:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790920621.632364:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790920621.632437:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.632539:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a180 going to sleep for 11 seconds 00000100:00100000:3.0:1790920621.633264:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972241920 00000100:00100000:3.0:1790920621.633577:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972241920 00000100:00100000:3.0:1790920621.633640:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790920621.633650:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790920621.634984:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972241920:12345-0@lo:502:mount.lustre.0 Request processed in 1331us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920621.634996:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790920621.635573:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972241920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790920621.635908:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1790920621.635924:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1790920621.640467:0:15679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790920621.640480:0:15679:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790920621.640488:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920621.640491:0:15679:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790920621.640498:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790920621.640514:0:15679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88eb41feb380) 00000020:00000080:1.0:1790920621.640538:0:15679:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790920621.640543:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790920621.640601:0:15679:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb32dc3800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790920621.640610:0:15679:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790920621.640615:0:15679:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2a4915844546b353 00010000:00010000:0.0:1790920621.654990:0:15679:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1790920621.656525:0:15679:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1790920621.664954:0:15679:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790920621.666878:0:15679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790920621.666890:0:15679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920621.666896:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920621.666898:0:15679:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790920621.666902:0:15679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790920621.666907:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920621.666908:0:15679:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790920621.666911:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790920621.666913:0:15679:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790920621.666915:0:15679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920621.666918:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920621.666919:0:15679:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790920621.666921:0:15679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790920621.666923:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920621.666924:0:15679:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790920621.666927:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790920621.666982:0:15679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790920621.666985:0:15679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790920621.666992:0:15679:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790920621.666995:0:15679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1790920621.671436:0:15678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790920621.671480:0:15678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790920621.671508:0:15678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a800/0x2a4915844546b33e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b345 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920621.671522:0:15678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3f56a800/0x2a4915844546b33e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b345 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920621.671530:0:15678:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb32dc3800 from 1 10000000:01000000:3.0:1790920621.671533:0:15678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790920621.671570:0:15678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920621.671578:0:15678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920621.671588:0:15678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920621.671613:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790920621.671687:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920621.671724:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0db44900 going to sleep for 11 seconds 00000100:00100000:0.0:1790920621.671870:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242048 00000100:00100000:0.0:1790920621.671878:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242048 00000100:00100000:0.0:1790920621.671917:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790920621.671925:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+17:15678:x1877915972242048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790920621.671938:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920621.671951:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b35a expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.671973:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b35a expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.671983:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b35a expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.671991:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52000, rc 0) 00000100:00100000:0.0:1790920621.672126:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242048:12345-0@lo:101:mount.lustre.0 Request processed in 189us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.672133:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790920621.678226:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790920621.678260:0:15678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920621.678532:0:15678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790920621.679443:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790920621.680614:0:15678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790920621.681573:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790920621.681635:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790920621.681720:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790920621.681741:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790920621.681863:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920621.681927:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920621.681982:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920621.682892:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242176 00000100:00100000:2.0:1790920621.682904:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242176 00000100:00100000:2.0:1790920621.682965:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790920621.682976:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920621.683285:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242176:12345-0@lo:501:mount.lustre.0 Request processed in 297us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920621.683293:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790920621.684004:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790920621.684058:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790920621.684121:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920621.684166:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920621.684283:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242304 00000100:00100000:3.0:1790920621.684289:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242304 00000100:00100000:3.0:1790920621.684336:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790920621.684345:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790920621.684494:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242304:12345-0@lo:503:mount.lustre.0 Request processed in 150us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920621.684501:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790920621.687435:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242304:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790920621.690018:0:15678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790920621.690130:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790920621.690222:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920621.690269:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920621.690616:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242432 00000100:00100000:3.0:1790920621.690625:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242432 00000100:00100000:3.0:1790920621.690683:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790920621.690692:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790920621.690930:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242432:12345-0@lo:502:mount.lustre.0 Request processed in 238us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920621.690938:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790920621.691175:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790920621.691645:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790920621.691700:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790920621.691866:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790920621.691902:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790920621.691929:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790920621.691967:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790920621.692016:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790920621.692042:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790920621.692077:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790920621.693542:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920621.693598:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920621.693890:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242560 00000100:00100000:2.0:1790920621.693899:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242560 00000100:00100000:2.0:1790920621.693999:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790920621.694008:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790920621.694427:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f656d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790920621.694574:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790920621.694589:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:2.0:1790920621.695442:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242560:12345-0@lo:502:mount.lustre.0 Request processed in 262us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920621.695456:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000020:01000000:1.0:1790920621.696091:0:15683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920621.696101:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920621.696104:0:15683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790920621.696110:0:15683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb32dc3800 00000020:00000080:1.0:1790920621.696120:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790920621.696127:0:15683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920621.696129:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920621.696130:0:15683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790920621.696132:0:15683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920621.696134:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920621.696142:0:15683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790920621.696145:0:15683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88eb32dc3800 00000020:00000080:1.0:1790920621.696147:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790920621.696206:0:15683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920621.696210:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920621.696211:0:15683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790920621.696214:0:15683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790920621.696216:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920621.696217:0:15683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790920621.696220:0:15683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88eb32dc3800 00000020:00000080:1.0:1790920621.696221:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790920621.696251:0:15683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790920621.696254:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790920621.696255:0:15683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790920621.696257:0:15683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1790920621.696511:0:15678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790920621.696535:0:15678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790920621.696556:0:15678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.696568:0:15678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920621.696612:0:15678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790920621.696623:0:15678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88eb32dc3800 10000000:01000000:0.0:1790920621.696626:0:15678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88eb32dc3800 10000000:01000000:0.0:1790920621.696630:0:15678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790920621.696636:0:15678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88eb32dc3800 from 1 10000000:01000000:0.0:1790920621.696639:0:15678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790920621.696675:0:15678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53600/0x2a4915844546b368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.696684:0:15678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53600/0x2a4915844546b368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.696695:0:15678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53600/0x2a4915844546b368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920621.696719:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790920621.696822:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920621.697501:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb1818ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790920621.700830:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242688 00000100:00100000:3.0:1790920621.700845:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242688 00000100:00100000:3.0:1790920621.700912:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790920621.700921:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972242688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790920621.700939:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920621.700958:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb07a52400/0x2a4915844546b36f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b368 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920621.700985:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb07a52400/0x2a4915844546b36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b368 expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920621.700995:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb07a52400/0x2a4915844546b36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b368 expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920621.701010:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a52400, rc 0) 00000100:00100000:3.0:1790920621.701099:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972242688:12345-0@lo:101:mount.lustre.0 Request processed in 178us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920621.701105:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790920621.705428:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790920621.705460:0:15678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53600/0x2a4915844546b368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b36f expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.705474:0:15678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53600/0x2a4915844546b368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b36f expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920621.714583:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1790920621.728699:0:15678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790920621.734248:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790920621.737446:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790920621.737496:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790920621.737574:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790920621.737612:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790920621.737662:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790920621.737698:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790920621.743247:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790920621.743458:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790920621.743493:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790920621.743518:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790920621.743565:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790920621.743595:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790920621.743630:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790920621.743666:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790920621.743692:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790920621.743717:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790920621.743883:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790920621.743912:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790920621.743936:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790920621.743970:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790920621.743996:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790920621.744021:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790920621.744069:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790920621.744124:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790920621.744162:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790920621.744212:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790920621.744248:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790920621.744282:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790920621.744343:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1790920621.744381:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1790920621.744413:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1790920621.744443:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1790920621.744487:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1790920621.744521:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1790920621.744566:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1790920621.744601:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1790920621.744699:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1790920621.744707:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1790920621.746467:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790920621.746538:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.746625:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790920621.751196:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242816 00000100:00100000:3.0:1790920621.751213:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242816 00000100:00100000:3.0:1790920621.751307:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790920621.751318:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972242816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790920621.751718:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972242816:12345-0@lo:501:mount.lustre.0 Request processed in 402us (5178us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920621.751738:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790920621.755694:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790920621.755791:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790920621.755879:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920621.755926:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb1818ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920621.756044:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972242944 00000100:00100000:2.0:1790920621.756051:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972242944 00000100:00100000:2.0:1790920621.756100:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790920621.756126:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972242944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790920621.756325:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972242944:12345-0@lo:503:mount.lustre.0 Request processed in 202us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920621.756333:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790920621.756387:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972242944:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790920621.757210:0:15678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790920621.757350:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972243072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790920621.757398:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.757429:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920621.757601:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243072 00000100:00100000:0.0:1790920621.757607:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243072 00000100:00100000:0.0:1790920621.757635:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790920621.757643:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972243072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790920621.757862:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972243072:12345-0@lo:502:mount.lustre.0 Request processed in 219us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.757870:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790920621.759689:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972243072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790920621.760036:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790920621.760097:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790920621.760147:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790920621.760195:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790920621.760236:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790920621.760306:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790920621.760346:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790920621.760380:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790920621.760432:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790920621.760471:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790920621.760508:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790920621.760555:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790920621.760590:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790920621.760626:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790920621.760674:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790920621.760724:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790920621.760774:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790920621.760816:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790920621.760853:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790920621.760879:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790920621.760927:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790920621.760957:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790920621.760983:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790920621.761019:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790920621.761046:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790920621.761072:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790920621.761124:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790920621.761160:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790920621.761193:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790920621.761235:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790920621.761276:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790920621.761316:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790920621.761343:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790920621.761389:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790920621.761421:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790920621.761457:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790920621.761484:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790920621.761513:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790920621.761560:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790920621.761595:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790920621.761644:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972243200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790920621.761712:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.761780:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920621.762155:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243200 00000100:00100000:1.0:1790920621.762163:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243200 00000100:00100000:1.0:1790920621.762216:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790920621.762226:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972243200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790920621.762535:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972243200:12345-0@lo:502:mount.lustre.0 Request processed in 309us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920621.762542:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790920621.762603:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972243200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790920621.762694:0:15678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790920621.762707:0:15678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790920621.775221:0:15688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790920621.775240:0:15688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88ea01f28000) 00000020:00000080:2.0:1790920621.775263:0:15688:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1790920621.775344:0:15688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88eb32dc3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790920621.775349:0:15688:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88eb32dc3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790920621.775352:0:15688:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88eb32dc3800 3 00010000:00080000:2.0:1790920621.775390:0:15688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88ea03345800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.134@tcp at head 00010000:00010000:0.0:1790920621.778466:0:15688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1790920621.778833:0:15688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790920621.778879:0:15688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790920621.778893:0:15688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2a4915844546b37d 00000100:00080000:0.0:1790920621.778904:0:15688:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790920621.778917:0:15688:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88ea03345800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1790920621.778956:0:15688:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb4189e300 x1877915972243328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790920621.778981:0:15688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790920621.780830:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1877915972243328:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790920621.780912:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790920621.781955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790920621.781960:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790920621.781963:0:36:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790920621.781969:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:2.0:1790920621.781974:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790920621.781984:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88eb09b00000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1790920621.782003:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb3f572d80 x1877915972243584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790920621.782060:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790920621.782072:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972243456:0@lo:400:kworker.0 00000100:00100000:2.0:1790920621.782124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.782157:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972243584:0@lo:8:kworker.0 00000100:00100000:2.0:1790920621.782180:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.782211:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243456 00000100:00100000:2.0:1790920621.782218:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243456 00000100:00100000:2.0:1790920621.782263:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243584 00000100:00100000:2.0:1790920621.782266:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243584 00000100:00100000:2.0:1790920621.782279:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920621.782287:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1877915972243456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920621.782334:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1877915972243456:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920621.782340:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790920621.782355:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920621.782358:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1877915972243584:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790920621.782396:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1877915972243584:12345-0@lo:8:kworker.0 Request processed in 37us (215us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790920621.782413:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920621.782446:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790920621.782453:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790920621.782456:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790920621.782459:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972243584:0@lo:8:kworker.0 00000100:00100000:2.0:1790920621.782486:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972243456:0@lo:400:kworker.0 00000100:00100000:0.0:1790920621.782805:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243328 00000100:00100000:0.0:1790920621.782812:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243328 00000100:00100000:0.0:1790920621.782835:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920621.782840:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877915972243328:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790920621.782855:0:14282:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1790920621.782888:0:14282:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2a4915844546b384 00000004:00100000:0.0:1790920621.782903:0:14282:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790920621.782930:0:14282:0:(import.c:65:import_set_state_nolock()) ffff88ea01b06800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920621.782971:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877915972243328:12345-0@lo:38:llog_process_th.0 Request processed in 129us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.782985:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1790920621.783150:0:15688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1790920621.783316:0:15678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790920621.783339:0:15678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790920621.783360:0:15678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53600/0x2a4915844546b368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b36f expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920621.783372:0:15678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53600/0x2a4915844546b368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b36f expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790920621.783411:0:15678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790920621.783413:0:15678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790920621.783415:0:15678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790920621.783416:0:15678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790920621.783417:0:15678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790920621.783418:0:15678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790920621.783420:0:15678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790920621.783422:0:15678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790920621.783423:0:15678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790920621.783427:0:15678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790920621.783429:0:15678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790920621.783431:0:15678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790920621.783432:0:15678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790920621.783433:0:15678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790920621.783434:0:15678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790920621.783439:0:15678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790920621.783440:0:15678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790920621.783441:0:15678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790920621.783442:0:15678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790920621.783470:0:15678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790920621.783486:0:15678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972243968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790920621.783522:0:15678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920621.783551:0:15678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920621.783567:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243968 00000100:00100000:1.0:1790920621.783571:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243968 00000100:00100000:1.0:1790920621.783596:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790920621.783601:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+19:15678:x1877915972243968:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790920621.783618:0:14273:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790920621.783630:0:14273:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1790920621.784957:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb4189e300 x1877915972243328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790920631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920621.784972:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790920621.784981:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790920621.784988:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790920621.784993:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790920621.784996:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88ea03345800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790920621.785003:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1877915972243328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790920621.788140:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972243840:0@lo:400:kworker.0 00000100:00100000:2.0:1790920621.788398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920621.788856:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790920621.788864:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972243712:0@lo:400:kworker.0 00000100:00100000:2.0:1790920621.788890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790920621.789208:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920621.794168:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243840 00000100:00100000:0.0:1790920621.794193:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243840 00000100:00100000:0.0:1790920621.794216:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972243712 00000100:00100000:0.0:1790920621.794219:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972243712 00000100:00100000:0.0:1790920621.794275:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790920621.794286:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972243712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920621.794377:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877915972243712:12345-0@lo:400:kworker.0 Request processed in 94us (5485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.794385:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790920621.794435:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920621.794450:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790920621.794457:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972243840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920621.794484:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972243840:12345-0@lo:400:kworker.0 Request processed in 28us (6089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.794490:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1790920621.796657:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3f571180 x1877915972243712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920621.796677:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877915972243712:0@lo:400:kworker.0 00010000:00080000:2.0:1790920621.796690:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88eb3f571c00 x1877915972243840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920621.796706:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972243840:0@lo:400:kworker.0 00010000:00010000:2.0:1790920621.801867:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1790920621.816671:0:14273:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790920621.816728:0:14273:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790920621.818597:0:14296:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790920621.818605:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790920621.818629:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.818647:0:14296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b25e expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.818656:0:14296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.818694:0:14296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546b25e expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.818731:0:14296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546b25e expref: 19 pid: 14274 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920621.818763:0:14296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14296:1877915972244096:0@lo:104: 00000100:00100000:0.0:1790920621.818828:0:14296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920621.818868:0:14296:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790920621.818891:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244096 00000100:00100000:0.0:1790920621.818897:0:14264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244096 00000100:00100000:0.0:1790920621.818937:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920621.818946:0:14264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+3:14296:x1877915972244096:12345-0@lo:104: 00010000:00010000:0.0:1790920621.818958:0:14264:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819005:0:14264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790920621.819010:0:14264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+3:14296:x1877915972244096:12345-0@lo:104: Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.819016:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790920621.819038:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920621.819044:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819051:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920621.819054:0:14268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819062:0:14268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920621.819079:0:14268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920621.819084:0:14268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790920621.819184:0:14268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819192:0:14268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920621.819215:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819221:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb41e37400/0x2a4915844546b25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b265 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819235:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920621.819237:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920621.819238:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920621.819253:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920621.819264:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972244224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920621.819292:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920621.819322:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244224 00000100:00100000:0.0:1790920621.819326:0:14265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244224 00010000:00010000:0.0:1790920621.819342:0:14265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b25e expref: 20 pid: 14274 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920621.819364:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920621.819371:0:14265:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6dbfc26-a70a-426c-a856-613d861b9981+20:3307:x1877915972244224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920621.819394:0:14265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920621.819405:0:14265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b25e expref: 20 pid: 14274 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819415:0:14265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546b25e expref: 20 pid: 14274 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819431:0:14265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819439:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790920621.819453:0:14265:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003063751s 00010000:00010000:0.0:1790920621.819458:0:14265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819466:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819473:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819480:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819485:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920621.819489:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819495:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819503:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819518:0:14265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920621.819547:0:14265:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6dbfc26-a70a-426c-a856-613d861b9981+20:3307:x1877915972244224:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920621.819553:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790920621.819591:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972244224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790920621.819618:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546b25e expref: 19 pid: 14274 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920621.819627:0:14296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14296:1877915972244096:0@lo:104: 00010000:00010000:0.0:1790920621.819636:0:14296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819644:0:14296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819650:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920621.819656:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3ae52e00/0x2a4915844546b38b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920621.825078:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+18:15678:x1877915972243968:12345-0@lo:253:mount.lustre.0 Request processed in 41465us (41543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920621.825095:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790920621.825228:0:15678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b6dbfc26-a70a-426c-a856-613d861b9981:15678:1877915972243968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790920621.825244:0:15678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790920621.825248:0:15678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790920621.825250:0:15678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790920621.825251:0:15678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790920621.825252:0:15678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790920621.825253:0:15678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790920621.825254:0:15678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790920621.825256:0:15678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790920621.825258:0:15678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790920621.825259:0:15678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790920621.825274:0:15678:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790920621.831043:0:15678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920621.831337:0:15678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790920621.831506:0:15678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920621.831700:0:15678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790920621.831899:0:15678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790920621.833026:0:15678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790920621.835047:0:15678:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790920621.891386:0:15678:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790920621.891395:0:15678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790920621.891428:0:15678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790920621.891500:0:15678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790920621.891512:0:15678:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790920621.891542:0:15678:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:0.0:1790920622.279411:0:6712:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1790920622.279462:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790920622.835044:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790920623.018897:0:14277:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790920623.018907:0:14277:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88eb3f5e5000 from 8 10000000:01000000:0.0:1790920623.018913:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790920623.018967:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52200/0x2a4915844546b392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920623.019000:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52200/0x2a4915844546b392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920623.019015:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52200/0x2a4915844546b392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920623.019046:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972244352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790920623.019142:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920623.019196:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790920623.019327:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244352 00000100:00100000:3.0:1790920623.019336:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244352 00000100:00100000:3.0:1790920623.019395:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790920623.019403:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+18:14277:x1877915972244352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920623.019417:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920623.019431:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb07a53000/0x2a4915844546b399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b392 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920623.019469:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb07a53000/0x2a4915844546b399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b392 expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920623.019481:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb07a53000/0x2a4915844546b399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b392 expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920623.019489:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a53000, rc 0) 00000100:00100000:3.0:1790920623.019530:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972244352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920623.019538:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790920623.020669:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972244352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790920623.020692:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52200/0x2a4915844546b392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b399 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920623.020703:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52200/0x2a4915844546b392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b399 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920623.020782:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972244480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790920623.020829:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920623.020862:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05ed2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790920623.021210:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244480 00000100:00100000:3.0:1790920623.021219:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244480 00000100:00100000:3.0:1790920623.021263:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790920623.021272:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972244480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790920623.021290:0:14273:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790920623.021306:0:14273:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790920623.021309:0:14273:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790920623.021384:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972244480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920623.021395:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790920623.021474:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972244480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790920623.021525:0:14277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790920623.021532:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52200/0x2a4915844546b392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b399 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920623.021540:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3ae52200/0x2a4915844546b392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b399 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920623.213037:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920623.213472:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972244608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920623.213547:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920623.213801:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244608 00000100:00100000:0.0:1790920623.213820:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244608 00000100:00080000:3.0:1790920623.213863:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920623.213883:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920623.213893:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972244608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920623.213931:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920623.213995:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972244608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920623.214002:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920623.214061:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790920623.214097:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972244608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790920623.848943:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920624.885907:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790920625.260900:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790920625.896956:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790920626.802227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790920626.802234:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790920626.802237:0:36:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790920626.802253:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88eb09b00000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:3.0:1790920626.802275:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88eb33f70700 x1877915972244992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790920626.802340:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972244992:0@lo:8:kworker.0 00000100:00100000:3.0:1790920626.802409:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920626.802481:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244992 00000100:00100000:3.0:1790920626.802489:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244992 00000100:00100000:3.0:1790920626.802552:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790920626.802559:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1877915972244992:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790920626.802587:0:14963:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1790920626.802615:0:14963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2a4915844546b3a0 00002000:00100000:3.0:1790920626.802627:0:14963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88eb3b9ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790920626.802632:0:14963:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790920626.802635:0:14963:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1790920626.802768:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972244736:0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.802804:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920626.802829:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972245376:0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.802857:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920626.802874:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920626.802879:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972244864:0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.802896:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920626.802919:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972245248:0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.802938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920626.802953:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790920626.802958:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972245120:0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.802990:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1790920626.802998:0:14963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1790920626.803025:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244736 00000100:00100000:0.0:1790920626.803029:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244736 00000100:00080000:3.0:1790920626.803031:0:14963:0:(import.c:65:import_set_state_nolock()) ffff88eb3b9eb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920626.803071:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790920626.803077:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+19:3304:x1877915972244736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920626.803078:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1877915972244992:12345-0@lo:8:kworker.0 Request processed in 518us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920626.803084:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790920626.803097:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972244864 00000100:00100000:3.0:1790920626.803106:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972244864 00000100:00100000:0.0:1790920626.803108:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+19:3304:x1877915972244736:12345-0@lo:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920626.803114:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790920626.803131:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790920626.803137:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972244864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.803138:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972245376 00000100:00100000:0.0:1790920626.803141:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972245376 00000100:00100000:0.0:1790920626.803160:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972245248 00000100:00100000:0.0:1790920626.803163:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972245248 00000100:00100000:3.0:1790920626.803167:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972244864:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920626.803172:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790920626.803174:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972245120 00000100:00100000:0.0:1790920626.803175:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972245120 00000100:00100000:0.0:1790920626.803187:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790920626.803190:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920626.803192:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972245376:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790920626.803194:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790920626.803216:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33f70700 x1877915972244992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790920651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920626.803219:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972245376:12345-0@lo:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920626.803224:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790920626.803231:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00100000:0.0:1790920626.803234:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1790920626.803238:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1790920626.803239:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972245248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790920626.803243:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790920626.803245:0:3303:0:(import.c:65:import_set_state_nolock()) ffff88eb09b00000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790920626.803257:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790920626.803261:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1877915972244992:0@lo:8:kworker.0 00000100:00100000:0.0:1790920626.803263:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972245248:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920626.803268:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790920626.803277:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1790920626.803283:0:14304:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1790920626.803283:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972245120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.803306:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972245120:12345-0@lo:400:kworker.0 Request processed in 24us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920626.803311:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790920626.803346:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33f73800 x1877915972245120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920626.803361:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972245120:0@lo:400:kworker.0 00010000:00080000:0.0:1790920626.803371:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33f72a00 x1877915972245248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920626.803378:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972245248:0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.803401:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972244864:0@lo:400:kworker.0 00000100:00100000:0.0:1790920626.803408:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972244736:0@lo:400:kworker.0 00010000:00080000:0.0:1790920626.803416:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb33f70a80 x1877915972245376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790920626.803423:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972245376:0@lo:400:kworker.0 00000004:00080000:3.0:1790920626.803630:0:14304:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 468969882209ns, next at 0ns, rc = 0 00000004:00080000:1.0:1790920626.803631:0:14305:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1790920626.803649:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14305:1877915972245632:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790920626.803676:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920626.803693:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb057f9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920626.803704:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972245504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920626.803734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920626.803784:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972245504 00000100:00100000:1.0:1790920626.803789:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972245504 00000100:00100000:1.0:1790920626.803817:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790920626.803824:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972245504:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790920626.803855:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1790920626.803863:0:14968:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790920626.803897:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877915972245504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920626.803904:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790920626.803926:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb3f654a80 x1877915972245504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790920642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790920626.803940:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972245504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920626.803955:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972245632 00000100:00100000:1.0:1790920626.803972:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972245632 00000100:00100000:1.0:1790920626.811367:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920626.811391:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14305:x1877915972245632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790920626.819292:0:14965:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1790920626.819304:0:14965:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1790920626.819310:0:14965:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1790920626.860236:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.860250:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.860268:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.860272:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.860278:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.860296:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.860307:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.860316:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.860348:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790920626.861024:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.861032:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.861043:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.861046:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.861051:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.861061:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.861070:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.861078:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.861094:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790920626.861490:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.861496:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.863976:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920626.863990:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864004:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ba00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.864009:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864032:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864357:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864367:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b3a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864394:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.864398:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864404:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.864408:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864416:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864426:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864433:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b3ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864444:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.864446:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.864452:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.864460:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.864556:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.864570:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.864578:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.864594:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.864604:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.864611:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.864631:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.864728:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.864735:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864744:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.864820:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864830:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864843:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864851:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b3b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.864873:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.864875:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.864877:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.865410:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.865417:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.865428:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.865431:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.865435:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.865445:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.865453:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.865465:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.865486:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.865546:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.865553:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.865562:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.865566:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.865583:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.865596:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.865603:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b3bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.865624:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.865626:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.865629:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.868781:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.868796:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868814:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.868819:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.868825:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868839:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868850:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868857:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868876:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920626.868889:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920626.868894:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868907:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56aa00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920626.868911:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868919:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868937:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868944:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b3c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.868960:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.868962:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.868964:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.869437:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.869444:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869454:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.869458:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.869463:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869473:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869487:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869495:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869510:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920626.869519:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920626.869524:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869531:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920626.869535:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869542:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869553:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869559:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.869573:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.869579:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.869581:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.870038:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.870045:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870054:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.870057:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.870062:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870070:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870077:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870084:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870098:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920626.870109:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920626.870115:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870122:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920626.870125:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870144:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870157:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870164:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870185:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.870187:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.870188:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.870635:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.870642:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870651:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.870654:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.870659:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870669:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870677:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870691:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870705:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920626.870715:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920626.870719:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870725:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920626.870729:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870736:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870772:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870781:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.870797:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.870799:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.870801:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.871200:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.871212:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.871220:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.871224:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.871229:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.871239:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.871246:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.871253:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790920626.873488:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1790920626.873879:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790920626.875341:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.875353:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.875371:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.875376:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.875382:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.875397:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.875414:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.875422:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877357:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790920626.877372:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877384:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920626.877388:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877398:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877428:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877437:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b3df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877456:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920626.877460:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877467:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920626.877471:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877479:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877488:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.877496:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920626.877497:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920626.877499:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.877634:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790920626.877641:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b3e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.877666:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.882989:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.883004:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.883030:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.883035:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.883041:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.883055:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.883066:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.883085:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.883113:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.883988:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.883998:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.884008:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56be00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.884022:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.884033:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.884053:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.884074:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdf6cc3/0x2a4915844546b3ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.884095:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.884097:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.884098:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.884289:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.884297:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.884308:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.884311:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.884316:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.884326:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.884334:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.884341:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.884396:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790920626.885260:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.885269:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.885285:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.885289:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.885294:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.885303:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.885310:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.885317:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887208:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920626.887221:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887234:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.887239:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887251:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887271:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887279:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9769fd4/0x2a4915844546b3f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887303:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.887307:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887320:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.887324:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887332:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887343:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.887351:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.887353:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.887355:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.887440:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790920626.887447:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d397646/0x2a4915844546b3fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.888083:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.889587:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.889599:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889614:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.889619:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.889625:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889648:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889658:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889666:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889685:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790920626.889697:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790920626.889702:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889710:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56a600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920626.889714:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889724:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889739:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889773:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e0ad8c5/0x2a4915844546b402 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.889793:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.889795:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920626.889796:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.890857:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.890865:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.890878:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.890881:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.890886:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.890897:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.890905:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.890927:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.890941:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.891151:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.891158:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.891166:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56aa00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.891170:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.891179:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.891193:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.891204:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efcecba/0x2a4915844546b409 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.891219:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.891221:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.891222:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.891847:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.891854:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.891873:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.891877:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.891882:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.891892:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.891900:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.891907:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.891919:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790920626.891931:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790920626.891938:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.891956:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56bc00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:3.0:1790920626.891960:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.891968:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.891980:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.891987:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc5a422/0x2a4915844546b410 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920626.892003:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920626.892005:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920626.892006:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.892563:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.892570:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.892579:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.892583:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.892587:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.892597:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.892615:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.892622:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.892643:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.893152:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.893160:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.893168:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b800 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.893172:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.893180:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.893194:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.893200:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e89277c2/0x2a4915844546b417 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.893214:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.893215:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.893216:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.893909:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.893929:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.893940:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.893943:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.893948:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.893959:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894048:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894059:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894090:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790920626.894517:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.894524:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894533:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.894536:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.894540:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894548:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894556:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894562:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.894574:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790920626.895210:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.895218:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895229:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.895237:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.895241:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895251:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895259:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895266:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895274:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790920626.895644:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.895651:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895658:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.895661:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.895665:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895673:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895681:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895690:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790920626.895693:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895697:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.895700:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790920626.895706:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ac00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.895710:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895719:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895736:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895744:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004496bfad/0x2a4915844546b41e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895785:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790920626.895789:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895795:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.895798:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895805:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895828:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895835:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004208f608/0x2a4915844546b425 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895848:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920626.895851:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895858:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56b200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.895861:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895868:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895878:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895885:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bdc889/0x2a4915844546b42c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895896:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.895899:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895911:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3f56ba00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.895914:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895922:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895933:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895939:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df61d27/0x2a4915844546b433 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.895951:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.895953:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.895954:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.895976:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.896358:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.896364:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.896373:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.896376:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.896381:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.896390:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.896398:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.896406:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.896429:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.896684:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.896690:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.896698:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.896701:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.896709:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.896728:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.896734:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cdb97d4/0x2a4915844546b43a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.896767:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.896769:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.896771:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.897323:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.897329:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.897344:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.897347:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.897352:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.897361:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.897369:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.897376:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.897398:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.897688:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.897695:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.897703:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37400 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.897707:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.897716:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.897730:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.897737:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1aa24ba/0x2a4915844546b441 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.897782:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.897784:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.897785:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.897947:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.897953:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.897962:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.897966:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.898084:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898094:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898114:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898121:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898141:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.898162:0:14268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.898167:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898176:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36a00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.898179:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898186:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898198:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898205:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c620eed2/0x2a4915844546b448 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898218:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.898219:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.898221:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.898516:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.898522:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898531:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.898534:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.898538:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898547:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898555:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898563:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.898594:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790920626.898656:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.898661:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898679:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.898682:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898690:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898702:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898709:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e37fd983/0x2a4915844546b44f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.898721:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.898723:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.898725:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.899186:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.899192:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899201:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.899204:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.899208:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899218:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899225:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899232:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899248:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790920626.899613:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.899619:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899627:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.899636:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.899641:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899650:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899659:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899666:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.899678:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790920626.899812:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920626.899819:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899827:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.899830:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899838:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899858:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899865:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f4cdbf9/0x2a4915844546b456 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899881:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.899884:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899890:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37a00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.899894:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899902:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899911:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899917:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ab0c349/0x2a4915844546b45d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.899928:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.899930:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.899937:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.899943:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790920626.900326:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790920626.900333:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.900342:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1790920626.900345:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920626.900350:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.900360:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.900369:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.900381:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920626.900403:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1790920626.900573:0:14965:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1790920626.900681:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14305:x1877915972245632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89297us (97000us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920626.900690:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790920626.900715:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920626.900721:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.900729:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920626.900734:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.900742:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.900772:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.900784:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f02349/0x2a4915844546b464 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920626.900800:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.900802:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920626.900803:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920626.901183:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14305:1877915972245632:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790920626.901201:0:14305:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1790920626.901249:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f657480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14305:1877915972245760:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790920626.901289:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920626.901335:0:14964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972245760 00000100:00100000:1.0:1790920626.901342:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb08c48300 going to sleep for 11 seconds 00000100:00100000:0.0:1790920626.901342:0:14964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972245760 00000100:00100000:0.0:1790920626.901428:0:14964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790920626.901438:0:14964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14305:x1877915972245760:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790920626.901477:0:14964:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1790920626.907393:0:14964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14305:x1877915972245760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5947us (6094us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790920626.907415:0:14964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790920626.907680:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f657480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14305:1877915972245760:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790920626.907697:0:14305:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1790920626.922909:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790920627.429898:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1790920627.429962:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790920627.945036:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920628.331239:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972245888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920628.331386:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920628.335092:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972245888 00000100:00100000:0.0:1790920628.335107:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972245888 00000100:00100000:0.0:1790920628.335190:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790920628.335216:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920628.335272:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972245888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920628.335313:0:14968:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920628.335405:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972245888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920628.335412:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790920628.335491:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972245888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790920628.970073:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790920629.301348:0:16037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790920629.993537:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790920631.016874:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920631.913218:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972246144:0@lo:400:kworker.0 00000100:00100000:3.0:1790920631.913307:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920631.913372:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972246656:0@lo:400:kworker.0 00000100:00100000:3.0:1790920631.913401:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920631.913424:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920631.913430:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972246272:0@lo:400:kworker.0 00000100:00100000:3.0:1790920631.913451:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920631.913489:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246144 00000100:00100000:3.0:1790920631.913507:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246144 00000100:00100000:3.0:1790920631.913559:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246272 00000100:00100000:3.0:1790920631.913562:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246272 00000100:00100000:3.0:1790920631.913579:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790920631.913587:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972246144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920631.913639:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972246144:12345-0@lo:400:kworker.0 Request processed in 53us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920631.913646:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790920631.913662:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790920631.913668:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972246272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920631.913695:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972246272:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920631.913701:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790920631.913717:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790920631.913721:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920631.913766:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790920631.913783:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972246272:0@lo:400:kworker.0 00000100:00100000:3.0:1790920631.913795:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972246144:0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914079:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972246400:0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914111:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920631.914143:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790920631.914150:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972246016:0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914177:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920631.914201:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972246528:0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914219:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920631.914244:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246016 00000100:00100000:2.0:1790920631.914248:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246016 00000100:00100000:2.0:1790920631.914277:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790920631.914284:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:3306:x1877915972246016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914319:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:3306:x1877915972246016:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920631.914326:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790920631.914354:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246656 00000100:00100000:2.0:1790920631.914367:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246656 00000100:00100000:2.0:1790920631.914396:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246400 00000100:00100000:2.0:1790920631.914399:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246400 00000100:00100000:2.0:1790920631.914410:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246528 00000100:00100000:2.0:1790920631.914412:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246528 00000100:00100000:2.0:1790920631.914426:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790920631.914432:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972246656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914469:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972246656:12345-0@lo:400:kworker.0 Request processed in 37us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920631.914474:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790920631.914486:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920631.914492:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972246400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914535:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972246400:12345-0@lo:400:kworker.0 Request processed in 45us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920631.914541:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920631.914552:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790920631.914557:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972246528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920631.914583:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972246528:12345-0@lo:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920631.914588:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790920631.914606:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920631.914624:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972246016:0@lo:400:kworker.0 00010000:00080000:2.0:1790920631.914635:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05628a80 x1877915972246528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920631.914646:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972246528:0@lo:400:kworker.0 00010000:00080000:2.0:1790920631.914655:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb0562aa00 x1877915972246400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920631.914670:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972246400:0@lo:400:kworker.0 00010000:00080000:2.0:1790920631.914701:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88eb05628700 x1877915972246656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790920647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790920631.914709:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972246656:0@lo:400:kworker.0 00000100:00100000:0.0:1790920631.915490:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790920631.915519:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972246784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920631.915561:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920631.915595:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246784 00000100:00100000:0.0:1790920631.915599:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246784 00000100:00100000:0.0:1790920631.915634:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790920631.915640:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972246784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790920631.915668:0:14968:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920631.915706:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972246784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920631.915713:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790920631.915787:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972246784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920632.019897:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.020108:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951275648 00000100:00100000:0.0:1790920632.020122:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951275648 00000100:00100000:0.0:1790920632.020190:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:0.0:1790920632.020201:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb058bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1877915951275648:12345-192.168.204.34@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790920632.020239:0:14273:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 574fd940-44bf-4bed-b114-917b4fd5a50a@192.168.204.34@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1790920632.020282:0:14273:0:(genops.c:1384:class_connect()) connect: client 574fd940-44bf-4bed-b114-917b4fd5a50a, cookie 0x2a4915844546b46b 00000100:00080000:0.0:1790920632.020502:0:14273:0:(import.c:65:import_set_state_nolock()) ffff88ea01b01000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920632.020933:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb058bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+5:2351:x1877915951275648:12345-192.168.204.34@tcp:250:mount.lustre.0 Request processed in 730us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.020944:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:0.0:1790920632.033712:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920632.033930:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951275776 00000100:00100000:2.0:1790920632.033946:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951275776 00000100:00100000:2.0:1790920632.034030:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:2.0:1790920632.034044:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+5:13718:x1877915951275776:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790920632.034071:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920632.034099:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae52 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.034140:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae52 expref: 6 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.034153:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36c00/0x2a4915844546b472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae52 expref: 6 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.034164:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36c00, rc 0) 00000100:00100000:2.0:1790920632.034246:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+6:13718:x1877915951275776:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 205us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920632.034255:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 77 00010000:00010000:2.0:1790920632.041411:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920632.048477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.048713:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951275904 00000100:00100000:0.0:1790920632.048725:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951275904 00000100:00100000:0.0:1790920632.048836:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:0.0:1790920632.048848:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+6:13718:x1877915951275904:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790920632.049489:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+6:13718:x1877915951275904:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 640us (1027us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790920632.049499:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:3.0:1790920632.052538:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.052854:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276032 00000100:00100000:0.0:1790920632.052867:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276032 00000100:00100000:0.0:1790920632.053014:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:0.0:1790920632.053027:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+6:13718:x1877915951276032:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790920632.053050:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920632.053076:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3ae53400/0x2a4915844546b479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae59 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920632.053132:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae53400/0x2a4915844546b479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae59 expref: 7 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920632.053146:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3ae53400/0x2a4915844546b479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae59 expref: 7 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920632.053157:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53400, rc 0) 00000100:00100000:0.0:1790920632.053236:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+7:13718:x1877915951276032:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 212us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.053244:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:3.0:1790920632.065648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.070865:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276160 00000100:00100000:0.0:1790920632.070887:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276160 00000100:00100000:0.0:1790920632.071247:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:0.0:1790920632.071261:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+7:13718:x1877915951276160:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790920632.073308:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13718:x1877915951276160:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 2038us (7743us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.073325:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:3.0:1790920632.083379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.084782:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276288 00000100:00100000:0.0:1790920632.084799:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276288 00000100:00100000:0.0:1790920632.084952:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:0.0:1790920632.084973:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13718:x1877915951276288:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790920632.085435:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13718:x1877915951276288:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 464us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.085445:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:3.0:1790920632.099192:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.099448:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276416 00000100:00100000:0.0:1790920632.099495:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276416 00000100:00100000:0.0:1790920632.099699:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:0.0:1790920632.099715:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13736:x1877915951276416:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790920632.103887:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13736:x1877915951276416:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 4160us (4694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920632.103906:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:3.0:1790920632.130948:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.131120:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276544 00000100:00100000:0.0:1790920632.131133:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276544 00000100:00100000:0.0:1790920632.131210:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:0.0:1790920632.131222:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13736:x1877915951276544:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790920632.131644:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13736:x1877915951276544:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 422us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.131655:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:0.0:1790920632.173740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920632.180495:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276672 00000100:00100000:3.0:1790920632.180597:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276672 00000100:00100000:3.0:1790920632.180902:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:3.0:1790920632.180928:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+8:13718:x1877915951276672:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790920632.180967:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920632.180994:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb07a52e00/0x2a4915844546b480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae83 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920632.181032:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb07a52e00/0x2a4915844546b480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae83 expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920632.181046:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb07a52e00/0x2a4915844546b480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae83 expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920632.181056:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a52e00, rc 0) 00000100:00100000:3.0:1790920632.181169:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+9:13718:x1877915951276672:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 246us (7442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920632.181177:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:3.0:1790920632.186674:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920632.188301:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276800 00000100:00100000:2.0:1790920632.188322:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276800 00000100:00100000:2.0:1790920632.188468:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:2.0:1790920632.188499:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+9:13718:x1877915951276800:12345-192.168.204.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790920632.188541:0:14275:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790920632.188561:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790920632.188566:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790920632.188570:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790920632.188572:0:14275:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790920632.190850:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+9:13718:x1877915951276800:12345-192.168.204.34@tcp:256:mount.lustre.0 Request processed in 2337us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920632.190867:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:3.0:1790920632.197568:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.198091:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951276928 00000100:00100000:0.0:1790920632.198178:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951276928 00000100:00100000:0.0:1790920632.198318:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:0.0:1790920632.198332:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+9:13718:x1877915951276928:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790920632.198357:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920632.198387:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edae8a expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920632.198429:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 10 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920632.198442:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 10 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920632.198452:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52800, rc 0) 00000100:00100000:0.0:1790920632.198549:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13718:x1877915951276928:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 220us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.198578:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:3.0:1790920632.206110:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920632.207049:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277056 00000100:00100000:2.0:1790920632.207067:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277056 00000100:00100000:2.0:1790920632.207164:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:2.0:1790920632.207178:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13718:x1877915951277056:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790920632.207654:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13718:x1877915951277056:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 477us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920632.207668:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:1.0:1790920632.215960:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.216623:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277184 00000100:00100000:0.0:1790920632.216640:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277184 00000100:00100000:0.0:1790920632.216724:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:0.0:1790920632.216737:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13718:x1877915951277184:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790920632.217335:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13718:x1877915951277184:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 597us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.217347:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:3.0:1790920632.232290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.232615:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277312 00000100:00100000:0.0:1790920632.232629:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277312 00000100:00100000:0.0:1790920632.232708:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:0.0:1790920632.232721:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13741:x1877915951277312:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790920632.235578:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13741:x1877915951277312:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 2843us (3287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.235597:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:3.0:1790920632.250362:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920632.250611:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277440 00000100:00100000:2.0:1790920632.250626:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277440 00000100:00100000:2.0:1790920632.250795:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 90 00000100:00100000:2.0:1790920632.250809:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13741:x1877915951277440:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790920632.251228:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13741:x1877915951277440:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 420us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920632.251238:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 90 00000100:00100000:1.0:1790920632.266306:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920632.267803:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277568 00000100:00100000:2.0:1790920632.267828:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277568 00000100:00100000:2.0:1790920632.268064:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:2.0:1790920632.270358:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1877915951277568:12345-192.168.204.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790920632.270441:0:14281:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5843125c-8114-4bc1-8486-e41e95eb2a70@192.168.204.34@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:2.0:1790920632.270513:0:14281:0:(genops.c:1384:class_connect()) connect: client 5843125c-8114-4bc1-8486-e41e95eb2a70, cookie 0x2a4915844546b48e 00000004:00100000:2.0:1790920632.270558:0:14281:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790920632.270566:0:14281:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1790920632.312320:0:14281:0:(import.c:65:import_set_state_nolock()) ffff88ea03346000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790920632.312439:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2351:x1877915951277568:12345-192.168.204.34@tcp:38:mount.lustre.0 Request processed in 44343us (46142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920632.312452:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:1.0:1790920632.320246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.320343:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277696 00000100:00100000:0.0:1790920632.320359:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277696 00000100:00100000:0.0:1790920632.320467:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:0.0:1790920632.320481:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:0:x1877915951277696:12345-192.168.204.34@tcp:41:mount.lustre.0 00000100:00100000:1.0:1790920632.320514:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920632.320554:0:14281:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790920632.320565:0:14281:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790920632.320794:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277824 00000100:00100000:1.0:1790920632.320798:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277824 00000100:00080000:2.0:1790920632.321053:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790920632.321104:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1790920632.321114:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+7:13718:x1877915951277824:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790920632.321161:0:16156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1790920632.321262:0:14280:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790920632.321288:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+7:13718:x1877915951277824:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 175us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.321295:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+7:0:x1877915951277696:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 818us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920632.321296:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1790920632.321301:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1790920632.327722:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920632.329886:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951277952 00000100:00100000:1.0:1790920632.329920:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951277952 00000100:00100000:3.0:1790920632.330638:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:3.0:1790920632.330654:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+6:13718:x1877915951277952:12345-192.168.204.34@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790920632.332197:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+6:13718:x1877915951277952:12345-192.168.204.34@tcp:40:mount.lustre.0 Request processed in 201us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920632.332218:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:3.0:1790920632.336381:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920632.336467:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920632.336509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920632.336587:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278080 00000100:00100000:0.0:1790920632.336622:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278080 00000100:00100000:1.0:1790920632.336670:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278336 00000100:00100000:1.0:1790920632.336675:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278336 00000100:00100000:0.0:1790920632.336682:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278208 00000100:00100000:0.0:1790920632.336685:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278208 00000100:00100000:0.0:1790920632.336700:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1790920632.336709:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1877915951278080:12345-192.168.204.34@tcp:8:mount.lustre.0 00000100:00100000:1.0:1790920632.336714:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1790920632.336720:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:13718:x1877915951278336:12345-192.168.204.34@tcp:33:mount.lustre.0 00010000:00080000:0.0:1790920632.336939:0:14963:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5843125c-8114-4bc1-8486-e41e95eb2a70@192.168.204.34@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1790920632.337093:0:14963:0:(genops.c:1384:class_connect()) connect: client 5843125c-8114-4bc1-8486-e41e95eb2a70, cookie 0x2a4915844546b495 00002000:00100000:0.0:1790920632.337112:0:14963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5843125c-8114-4bc1-8486-e41e95eb2a70/ffff88ea01b02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790920632.337150:0:14963:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790920632.338205:0:14963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790920632.338257:0:14963:0:(import.c:65:import_set_state_nolock()) ffff88ea01b05800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920632.338428:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2351:x1877915951278080:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 1717us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.338441:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1790920632.338483:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1790920632.338490:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1877915951278208:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790920632.338516:0:14963:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5843125c-8114-4bc1-8486-e41e95eb2a70@192.168.204.34@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1790920632.338545:0:14963:0:(genops.c:1384:class_connect()) connect: client 5843125c-8114-4bc1-8486-e41e95eb2a70, cookie 0x2a4915844546b49c 00002000:00100000:0.0:1790920632.338557:0:14963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5843125c-8114-4bc1-8486-e41e95eb2a70/ffff88ea01b01800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790920632.338569:0:14963:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790920632.338949:0:14963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790920632.338972:0:14963:0:(import.c:65:import_set_state_nolock()) ffff88ea01b06000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790920632.339003:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2351:x1877915951278208:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 512us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920632.339011:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000004:00080000:2.0:1790920632.341720:0:14283:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4853us 00000004:00200000:2.0:1790920632.366608:0:14283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790920632.366731:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:13718:x1877915951278336:12345-192.168.204.34@tcp:33:mount.lustre.0 Request processed in 30004us (31201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920632.366776:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000001:00100000:2.0:1790920632.494044:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5843125c-8114-4bc1-8486-e41e95eb2a70 00000001:00100000:1.0:1790920632.500394:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5843125c-8114-4bc1-8486-e41e95eb2a70 00000100:00100000:1.0:1790920632.654421:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920632.654553:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278464 00000100:00100000:2.0:1790920632.654565:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278464 00000100:00100000:2.0:1790920632.654631:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1790920632.654887:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+6:13762:x1877915951278464:12345-192.168.204.34@tcp:101:mkdir.0 00010000:00010000:2.0:1790920632.654921:0:16156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920632.654951:0:16156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b4a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaeb4 expref: -99 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.655023:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b4aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.655055:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.655072:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920632.655110:0:16156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790920632.655114:0:16156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920632.655151:0:16156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.655178:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37400/0x2a4915844546b4a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeb4 expref: 8 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.655196:0:16156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b4aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeb4 expref: 7 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920632.655203:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:2.0:1790920632.655206:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920632.655211:0:16156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36a00, rc 0) 00000100:00100000:2.0:1790920632.655278:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+7:13762:x1877915951278464:12345-192.168.204.34@tcp:101:mkdir.0 Request processed in 395us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920632.655285:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00010000:00010000:1.0:1790920633.066461:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920633.452166:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972246912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920633.452286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920633.452536:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972246912 00000100:00100000:0.0:1790920633.452549:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972246912 00000100:00100000:0.0:1790920633.452656:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790920633.452670:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972246912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790920633.452700:0:14968:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790920633.452813:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972246912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920633.452821:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790920633.453634:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920633.453694:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972246912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790920634.089317:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920634.851089:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920634.851321:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278592 00000100:00100000:0.0:1790920634.851336:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278592 00000100:00100000:0.0:1790920634.851433:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1790920634.851445:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+7:13815:x1877915951278592:12345-192.168.204.34@tcp:41:lfs.0 00000004:00000024:0.0:1790920634.851527:0:14282:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790920634.851649:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+7:13815:x1877915951278592:12345-192.168.204.34@tcp:41:lfs.0 Request processed in 205us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920634.851657:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00080000:2.0:1790920634.853326:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920634.855625:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920634.855992:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278720 00000100:00100000:0.0:1790920634.856008:0:14968:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278720 00000100:00100000:0.0:1790920634.856117:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1790920634.856131:0:14968:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5843125c-8114-4bc1-8486-e41e95eb2a70+5:13815:x1877915951278720:12345-192.168.204.34@tcp:13:lfs.0 00002000:00000024:0.0:1790920634.856189:0:14968:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790920634.856390:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790920634.856593:0:14968:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5843125c-8114-4bc1-8486-e41e95eb2a70+5:13815:x1877915951278720:12345-192.168.204.34@tcp:13:lfs.0 Request processed in 463us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920634.856603:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1790920634.868495:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920634.868636:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278848 00000100:00100000:3.0:1790920634.868650:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278848 00000100:00100000:3.0:1790920634.868743:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:3.0:1790920634.868830:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5843125c-8114-4bc1-8486-e41e95eb2a70+5:13815:x1877915951278848:12345-192.168.204.34@tcp:13:lfs.0 00002000:00000024:3.0:1790920634.868896:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920634.869011:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5843125c-8114-4bc1-8486-e41e95eb2a70+5:13815:x1877915951278848:12345-192.168.204.34@tcp:13:lfs.0 Request processed in 185us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920634.869019:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00080000:2.0:1790920634.869248:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790920635.112955:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920635.120492:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920635.120623:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951278976 00000100:00100000:0.0:1790920635.120635:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951278976 00000100:00100000:0.0:1790920635.120705:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:0.0:1790920635.120732:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+10:13847:x1877915951278976:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790920635.120785:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920635.120805:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b4b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaebb expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920635.120836:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaebb expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920635.120847:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3ae53200/0x2a4915844546b4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaebb expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920635.120869:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53200, rc 0) 00000100:00100000:0.0:1790920635.120941:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13847:x1877915951278976:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 212us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920635.120948:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:1.0:1790920635.130865:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.131031:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951279104 00000100:00100000:2.0:1790920635.131050:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951279104 00000100:00100000:2.0:1790920635.131157:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:2.0:1790920635.131171:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13847:x1877915951279104:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790920635.132303:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13847:x1877915951279104:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 1126us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.132315:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:1.0:1790920635.142809:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920635.143147:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951279232 00000100:00100000:3.0:1790920635.143159:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951279232 00000100:00100000:3.0:1790920635.143258:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:3.0:1790920635.143269:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13847:x1877915951279232:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790920635.143598:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13847:x1877915951279232:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 330us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920635.143606:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:1.0:1790920635.161053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.161472:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951279360 00000100:00100000:2.0:1790920635.161484:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951279360 00000100:00100000:2.0:1790920635.161548:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:2.0:1790920635.161558:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13854:x1877915951279360:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790920635.162000:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13854:x1877915951279360:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 441us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.162009:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:1.0:1790920635.173676:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920635.173829:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951279488 00000100:00100000:3.0:1790920635.173847:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951279488 00000100:00100000:3.0:1790920635.173939:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:3.0:1790920635.173951:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13854:x1877915951279488:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790920635.174268:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13854:x1877915951279488:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 319us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920635.174278:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:1.0:1790920635.189151:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920635.190622:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951279616 00000100:00100000:0.0:1790920635.190642:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951279616 00000100:00100000:2.0:1790920635.192448:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 96 00000100:00100000:2.0:1790920635.192468:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13847:x1877915951279616:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790920635.192496:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920635.192524:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e37400/0x2a4915844546b4b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaee5 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920635.192569:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e37400/0x2a4915844546b4b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaee5 expref: 12 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920635.192605:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e37400/0x2a4915844546b4b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaee5 expref: 12 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920635.192616:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37400, rc 0) 00000100:00100000:2.0:1790920635.192722:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13847:x1877915951279616:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 260us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.192729:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 96 00000100:00100000:1.0:1790920635.196416:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.196613:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951279744 00000100:00100000:2.0:1790920635.196628:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951279744 00000100:00100000:2.0:1790920635.197135:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:2.0:1790920635.197153:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13847:x1877915951279744:12345-192.168.204.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790920635.197194:0:14275:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790920635.197228:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790920635.197233:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790920635.197236:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790920635.197239:0:14275:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790920635.199463:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13847:x1877915951279744:12345-192.168.204.34@tcp:256:mount.lustre.0 Request processed in 2291us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.200650:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:1.0:1790920635.203014:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920635.203192:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951279872 00000100:00100000:3.0:1790920635.203210:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951279872 00000100:00100000:3.0:1790920635.203294:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:3.0:1790920635.203456:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13847:x1877915951279872:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790920635.203476:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920635.203498:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaeec expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920635.203537:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920635.203550:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920635.203560:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a52a00, rc 0) 00000100:00100000:3.0:1790920635.203652:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13847:x1877915951279872:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 348us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920635.204522:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:1.0:1790920635.211080:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.212041:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280000 00000100:00100000:2.0:1790920635.212061:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280000 00000100:00100000:2.0:1790920635.212141:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:2.0:1790920635.212154:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13847:x1877915951280000:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790920635.214293:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13847:x1877915951280000:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 2125us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.214327:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:3.0:1790920635.217264:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.217432:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280128 00000100:00100000:2.0:1790920635.217448:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280128 00000100:00100000:2.0:1790920635.218051:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:2.0:1790920635.218066:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13847:x1877915951280128:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790920635.218613:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13847:x1877915951280128:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 548us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.218624:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:3.0:1790920635.223893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.224291:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280256 00000100:00100000:2.0:1790920635.224307:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280256 00000100:00100000:2.0:1790920635.224376:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:2.0:1790920635.224388:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13856:x1877915951280256:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790920635.225146:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13856:x1877915951280256:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 754us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.225158:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:1.0:1790920635.236531:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.236985:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280384 00000100:00100000:2.0:1790920635.236999:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280384 00000100:00100000:2.0:1790920635.237071:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:2.0:1790920635.237083:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13856:x1877915951280384:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790920635.237406:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13856:x1877915951280384:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 325us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.237416:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:1.0:1790920635.247038:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920635.247159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920635.247830:0:14964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281024 00000100:00100000:0.0:1790920635.247830:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280896 00000100:00100000:3.0:1790920635.247845:0:14964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281024 00000100:00100000:0.0:1790920635.247845:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280896 00000100:00100000:3.0:1790920635.247936:0:14964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1790920635.247940:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:3.0:1790920635.247952:0:14964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2353:x1877915951281024:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920635.247955:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+7:2353:x1877915951280896:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920635.248072:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+7:2353:x1877915951280896:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 110us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920635.248082:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:3.0:1790920635.258990:0:14964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2353:x1877915951281024:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 11022us (11947us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920635.259010:0:14964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1790920635.259326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920635.261836:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280512 00000100:00100000:3.0:1790920635.261871:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280512 00000100:00100000:3.0:1790920635.261958:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:3.0:1790920635.261970:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1877915951280512:12345-192.168.204.34@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790920635.262015:0:14282:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9b496f1b-f428-4353-85dd-ead3c534fea1@192.168.204.34@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1790920635.262071:0:14282:0:(genops.c:1384:class_connect()) connect: client 9b496f1b-f428-4353-85dd-ead3c534fea1, cookie 0x2a4915844546b4c6 00000004:00100000:3.0:1790920635.262118:0:14282:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790920635.262308:0:14282:0:(import.c:65:import_set_state_nolock()) ffff88eb32dc2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790920635.262409:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2351:x1877915951280512:12345-192.168.204.34@tcp:38:mount.lustre.0 Request processed in 439us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920635.262418:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1790920635.277315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920635.277370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920635.277800:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280768 00000100:00100000:0.0:1790920635.277823:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280768 00000100:00100000:0.0:1790920635.277927:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951280640 00000100:00100000:0.0:1790920635.277953:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951280640 00000100:00100000:0.0:1790920635.277985:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1790920635.277997:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+7:13847:x1877915951280768:12345-192.168.204.34@tcp:41:mount.lustre.0 00000100:00100000:1.0:1790920635.278254:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:1.0:1790920635.278266:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+7:0:x1877915951280640:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790920635.278304:0:14282:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790920635.278409:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+7:0:x1877915951280640:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 145us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920635.278416:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000004:00000024:0.0:1790920635.278597:0:14280:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790920635.278629:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+6:13847:x1877915951280768:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 634us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920635.278635:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00080000:3.0:1790920635.279728:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790920635.285634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920635.285927:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281152 00000100:00100000:1.0:1790920635.285943:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281152 00000100:00100000:1.0:1790920635.286031:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1790920635.286044:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+6:13847:x1877915951281152:12345-192.168.204.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790920635.286339:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+6:13847:x1877915951281152:12345-192.168.204.34@tcp:40:mount.lustre.0 Request processed in 297us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920635.286348:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:2.0:1790920635.298421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920635.298478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920635.298630:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281536 00000100:00100000:1.0:1790920635.298645:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281536 00000100:00100000:1.0:1790920635.298729:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:1.0:1790920635.298743:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+6:13847:x1877915951281536:12345-192.168.204.34@tcp:33:mount.lustre.0 00000100:00100000:2.0:1790920635.298827:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920635.301452:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281280 00000100:00100000:0.0:1790920635.301470:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281280 00000100:00100000:1.0:1790920635.301778:0:14964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281408 00000100:00100000:1.0:1790920635.301784:0:14964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281408 00000100:00100000:1.0:1790920635.301813:0:14964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1790920635.301822:0:14964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1877915951281280:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790920635.301876:0:14964:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9b496f1b-f428-4353-85dd-ead3c534fea1@192.168.204.34@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:1.0:1790920635.301922:0:14964:0:(genops.c:1384:class_connect()) connect: client 9b496f1b-f428-4353-85dd-ead3c534fea1, cookie 0x2a4915844546b4cd 00002000:00100000:1.0:1790920635.301938:0:14964:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9b496f1b-f428-4353-85dd-ead3c534fea1/ffff88eb41fda000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790920635.301954:0:14964:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790920635.302419:0:14964:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790920635.302474:0:14964:0:(import.c:65:import_set_state_nolock()) ffff88eb41fdd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790920635.302864:0:14964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2351:x1877915951281280:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 1039us (4382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920635.302874:0:14964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1790920635.302905:0:14964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:1.0:1790920635.302911:0:14964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1877915951281408:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790920635.302933:0:14964:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9b496f1b-f428-4353-85dd-ead3c534fea1@192.168.204.34@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:1.0:1790920635.302958:0:14964:0:(genops.c:1384:class_connect()) connect: client 9b496f1b-f428-4353-85dd-ead3c534fea1, cookie 0x2a4915844546b4d4 00002000:00100000:1.0:1790920635.302991:0:14964:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b496f1b-f428-4353-85dd-ead3c534fea1/ffff88eb09ba4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790920635.303001:0:14964:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1790920635.303226:0:14963:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790920635.303238:0:14963:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:1.0:1790920635.303379:0:14964:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000004:00200000:2.0:1790920635.303606:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790920635.303684:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+6:13847:x1877915951281536:12345-192.168.204.34@tcp:33:mount.lustre.0 Request processed in 4942us (5276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.303693:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00080000:2.0:1790920635.316245:0:14964:0:(import.c:65:import_set_state_nolock()) ffff88eb09ba6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790920635.316401:0:14964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2351:x1877915951281408:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 13479us (17566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920635.316416:0:14964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:2.0:1790920635.472224:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920635.472913:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281664 00000100:00100000:1.0:1790920635.472927:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281664 00000100:00100000:1.0:1790920635.473060:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1790920635.473074:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+6:13877:x1877915951281664:12345-192.168.204.34@tcp:101:mkdir.0 00010000:00010000:1.0:1790920635.473105:0:16156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920635.473137:0:16156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546b4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf16 expref: -99 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920635.473226:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920635.473244:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920635.473259:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920635.473304:0:16156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790920635.473308:0:16156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790920635.473336:0:16156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920635.473369:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443cc00/0x2a4915844546b4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 8 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920635.473393:0:16156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 7 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920635.473422:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:1.0:1790920635.473425:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790920635.473431:0:16156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c800, rc 0) 00000100:00100000:1.0:1790920635.473521:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+7:13877:x1877915951281664:12345-192.168.204.34@tcp:101:mkdir.0 Request processed in 450us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920635.473529:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000040:00080000:2.0:1790920635.498554:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790920636.137327:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920637.033951:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972247040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790920637.034061:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920637.034113:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972247296:0@lo:400:kworker.0 00000100:00100000:1.0:1790920637.034138:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972247552:0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034149:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920637.034162:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920637.034179:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972247808:0@lo:400:kworker.0 00000100:00100000:1.0:1790920637.034179:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790920637.034184:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972247424:0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920637.034200:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920637.034219:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790920637.034224:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b6dbfc26-a70a-426c-a856-613d861b9981:3305:1877915972247168:0@lo:400:kworker.0 00000100:00100000:1.0:1790920637.034233:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247040 00000100:00100000:1.0:1790920637.034243:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247040 00000100:00100000:3.0:1790920637.034252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920637.034275:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972247680:0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920637.034313:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790920637.034323:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972247040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920637.034340:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247296 00000100:00100000:3.0:1790920637.034343:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247296 00002000:00000024:1.0:1790920637.034374:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920637.034382:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247424 00000100:00100000:3.0:1790920637.034385:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247424 00000100:00100000:3.0:1790920637.034404:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790920637.034410:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972247296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920637.034427:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877915972247040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920637.034433:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790920637.034467:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247552 00000100:00100000:1.0:1790920637.034470:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247552 00000100:00100000:1.0:1790920637.034497:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247808 00000100:00100000:1.0:1790920637.034501:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247808 00000100:00100000:1.0:1790920637.034529:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247680 00000100:00100000:1.0:1790920637.034532:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247680 00000100:00100000:1.0:1790920637.034548:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790920637.034553:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972247552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920637.034589:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877915972247552:12345-0@lo:400:kworker.0 Request processed in 35us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920637.034595:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972247296:12345-0@lo:400:kworker.0 Request processed in 185us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920637.034595:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790920637.034601:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790920637.034608:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790920637.034613:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920637.034614:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972247808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034619:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972247424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034640:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972247424:12345-0@lo:400:kworker.0 Request processed in 21us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920637.034640:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877915972247808:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920637.034646:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920637.034647:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790920637.034658:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790920637.034664:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972247680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034667:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247168 00000100:00100000:3.0:1790920637.034670:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247168 00000100:00100000:1.0:1790920637.034690:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877915972247680:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920637.034695:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790920637.034696:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790920637.034702:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:3305:x1877915972247168:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790920637.034720:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790920637.034725:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790920637.034727:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920637.034730:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:3305:x1877915972247168:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920637.034736:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790920637.034796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972247424:0@lo:400:kworker.0 00000100:00100000:1.0:1790920637.034808:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877915972247552:0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034811:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b6dbfc26-a70a-426c-a856-613d861b9981:3305:1877915972247168:0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034834:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1877915972247680:0@lo:400:kworker.0 00000100:00100000:1.0:1790920637.034834:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972247040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920637.034842:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972247296:0@lo:400:kworker.0 00000100:00100000:3.0:1790920637.034851:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1877915972247808:0@lo:400:kworker.0 00010000:00010000:0.0:1790920637.163788:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790920637.666741:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5843125c-8114-4bc1-8486-e41e95eb2a70 00000001:00100000:0.0:1790920637.669160:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9b496f1b-f428-4353-85dd-ead3c534fea1 00000001:00100000:0.0:1790920637.690846:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b496f1b-f428-4353-85dd-ead3c534fea1 00000001:00100000:0.0:1790920637.695396:0:6712:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b496f1b-f428-4353-85dd-ead3c534fea1 00010000:00010000:2.0:1790920638.193604:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920638.574209:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972247936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920638.574316:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920638.577973:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972247936 00000100:00100000:2.0:1790920638.577993:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972247936 00000100:00100000:3.0:1790920638.578328:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790920638.578341:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972247936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790920638.578394:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920638.578514:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972247936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (4198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920638.578522:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790920638.578654:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972247936:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790920638.959327:0:16251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790920639.210080:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920640.233433:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920640.651635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920640.651800:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920640.651849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920640.651873:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920640.651892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920640.651912:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920640.651941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920640.651993:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282048 00000100:00100000:0.0:1790920640.652006:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282048 00000100:00100000:0.0:1790920640.652080:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282560 00000100:00100000:0.0:1790920640.652083:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282560 00000100:00100000:0.0:1790920640.652102:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282176 00000100:00100000:0.0:1790920640.652105:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282176 00000100:00100000:0.0:1790920640.652118:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282432 00000100:00100000:0.0:1790920640.652121:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282432 00000100:00100000:0.0:1790920640.652139:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1790920640.652150:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2352:x1877915951282048:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920640.652245:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2352:x1877915951282048:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 96us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920640.652254:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1790920640.652274:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1790920640.652280:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2352:x1877915951282560:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920640.652309:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2352:x1877915951282560:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920640.652314:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1790920640.652325:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1790920640.652331:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2352:x1877915951282176:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920640.652352:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2352:x1877915951282176:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 21us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920640.652357:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1790920640.652367:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1790920640.652373:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2352:x1877915951282432:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920640.652395:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2352:x1877915951282432:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920640.652408:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1790920640.652430:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282304 00000100:00100000:0.0:1790920640.652434:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282304 00000100:00100000:0.0:1790920640.652468:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281920 00000100:00100000:0.0:1790920640.652472:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281920 00000100:00100000:0.0:1790920640.652929:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:0.0:1790920640.652943:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2352:x1877915951282304:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920640.652984:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2352:x1877915951282304:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 44us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920640.652991:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:0.0:1790920640.653004:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:0.0:1790920640.653009:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2352:x1877915951281920:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920640.653034:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2352:x1877915951281920:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920640.653039:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00080000:0.0:1790920640.653079:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790920640.653084:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920640.653087:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790920640.656047:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951281792 00000100:00100000:2.0:1790920640.656146:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951281792 00000100:00100000:2.0:1790920640.656231:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:2.0:1790920640.656242:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:2352:x1877915951281792:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920640.656342:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:2352:x1877915951281792:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 102us (4726us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920640.656350:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 104 00010000:00010000:0.0:1790920641.258130:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920642.153888:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972248064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790920642.153980:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920642.154066:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972248064 00000100:00100000:3.0:1790920642.154076:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972248064 00000100:00100000:3.0:1790920642.154149:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790920642.154159:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972248064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790920642.154201:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790920642.154246:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972248064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920642.154254:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790920642.154304:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972248064:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790920642.154811:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790920642.156061:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972248192:0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.156146:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920642.156190:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972248704:0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.156215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920642.156244:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920642.156249:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972248320:0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.156272:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920642.156330:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972248192 00000100:00100000:3.0:1790920642.156338:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972248192 00000100:00100000:3.0:1790920642.156386:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790920642.156394:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+19:3304:x1877915972248192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.156442:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+19:3304:x1877915972248192:12345-0@lo:400:kworker.0 Request processed in 48us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920642.156449:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790920642.156586:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972248704 00000100:00100000:3.0:1790920642.156590:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972248704 00000100:00100000:3.0:1790920642.156637:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920642.156643:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972248704:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790920642.156771:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920642.156826:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877915972248704:12345-0@lo:400:kworker.0 Request processed in 182us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920642.156833:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920642.156851:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972248320 00000100:00100000:3.0:1790920642.156854:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972248320 00000100:00100000:3.0:1790920642.156918:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790920642.156924:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972248320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.156957:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972248320:12345-0@lo:400:kworker.0 Request processed in 34us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920642.156963:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790920642.156990:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972248448:0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.157013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920642.157033:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790920642.157040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972248576:0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.157057:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920642.157078:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972248448 00000100:00100000:3.0:1790920642.157089:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972248448 00000100:00100000:3.0:1790920642.157108:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972248576 00000100:00100000:3.0:1790920642.157110:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972248576 00000100:00100000:0.0:1790920642.159993:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790920642.160017:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972248448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920642.160147:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877915972248448:12345-0@lo:400:kworker.0 Request processed in 140us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920642.160155:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790920642.160266:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790920642.160771:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920642.160846:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790920642.160858:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972248576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.161259:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877915972248576:12345-0@lo:400:kworker.0 Request processed in 402us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920642.161514:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972248320:0@lo:400:kworker.0 00000100:00100000:2.0:1790920642.161531:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972248192:0@lo:400:kworker.0 00000100:00100000:2.0:1790920642.161557:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1877915972248704:0@lo:400:kworker.0 00000100:00100000:2.0:1790920642.161639:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1877915972248576:0@lo:400:kworker.0 00000100:00100000:2.0:1790920642.161653:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877915972248448:0@lo:400:kworker.0 00000100:00100000:3.0:1790920642.171171:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1790920642.283733:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790920642.836716:0:16400:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7b389400 20000000:00000080:1.0:1790920642.836735:0:16400:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88eb18a0c400 uarg=0000000000000000 20000000:01000000:1.0:1790920642.836913:0:16400:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790920642.836920:0:16400:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790920642.836925:0:16400:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790920642.838140:0:16401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1790920642.838308:0:16400:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790920642.850289:0:16400:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790920642.850721:0:16400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850743:0:16400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850778:0:16400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b226 expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850787:0:16400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b35a expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850797:0:16400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850804:0:16400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850812:0:16400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850858:0:16400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.850887:0:16400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 12 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.850903:0:16400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972248832:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920642.851522:0:16400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 12 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.851533:0:16400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 12 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.851544:0:16400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972248960:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920642.851596:0:16400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546b35a expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.851605:0:16400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546b35a expref: 18 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.851615:0:16400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972249088:0@lo:104: 00000100:00100000:2.0:1790920642.852086:0:16400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920642.852155:0:14263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249088 00000100:00100000:3.0:1790920642.852164:0:14263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249088 00000100:00100000:3.0:1790920642.852220:0:14263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790920642.852230:0:14263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b6dbfc26-a70a-426c-a856-613d861b9981+3:16400:x1877915972249088:12345-0@lo:104: 00010000:00010000:3.0:1790920642.852243:0:14263:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.852289:0:16400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546b226 expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.852300:0:16400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546b226 expref: 18 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920642.852304:0:14263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790920642.852314:0:14263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b6dbfc26-a70a-426c-a856-613d861b9981+3:16400:x1877915972249088:12345-0@lo:104: Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920642.852315:0:16400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972249216:0@lo:104: 00000100:00100000:3.0:1790920642.852334:0:14263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920642.852346:0:16400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790920642.852398:0:16400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.852407:0:16400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 18 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.852416:0:16400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972249344:0@lo:104: 00000100:00100000:0.0:1790920642.852436:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249216 00000100:00100000:0.0:1790920642.852442:0:14264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249216 00000100:00100000:2.0:1790920642.852443:0:16400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920642.852458:0:16400:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee240 going to sleep for 11 seconds 00000100:00100000:0.0:1790920642.852475:0:14264:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790920642.852481:0:16400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f573800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972249088:0@lo:104: 00000100:00100000:0.0:1790920642.852487:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249344 00000100:00100000:0.0:1790920642.852491:0:14264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249344 00000100:00100000:0.0:1790920642.852506:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790920642.852513:0:14264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+4:16400:x1877915972249216:12345-0@lo:104: 00010000:00010000:0.0:1790920642.852522:0:14264:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852571:0:14264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790920642.852577:0:14264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+4:16400:x1877915972249216:12345-0@lo:104: Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920642.852583:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790920642.852598:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790920642.852606:0:14264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+3:16400:x1877915972249344:12345-0@lo:104: 00010000:00010000:0.0:1790920642.852614:0:14264:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.852633:0:16400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972249216:0@lo:104: 00010000:00010000:0.0:1790920642.852645:0:14264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790920642.852651:0:14264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b6dbfc26-a70a-426c-a856-613d861b9981+3:16400:x1877915972249344:12345-0@lo:104: Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920642.852657:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790920642.852696:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790920642.852713:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852722:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53e00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920642.852726:0:14269:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852769:0:14269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920642.852776:0:14269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920642.852782:0:14269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790920642.852810:0:14269:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852816:0:14269:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920642.852839:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852847:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb07a53e00/0x2a4915844546b35a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b361 expref: -99 pid: 15678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852862:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790920642.852865:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852872:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53e00 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920642.852875:0:14269:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852882:0:14269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.852886:0:16400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34251f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972249344:0@lo:104: 10000000:00010000:0.0:1790920642.852893:0:14269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920642.852906:0:14269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790920642.852922:0:14269:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852928:0:14269:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920642.852952:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852959:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb3ae53e00/0x2a4915844546b226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b22d expref: -99 pid: 14962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852969:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920642.852972:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852978:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e36800 already unused, calling callback (ffffffffc1c7fc20) 10000000:00010000:0.0:1790920642.852981:0:14269:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.852987:0:14269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790920642.852993:0:14269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790920642.852998:0:14269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790920642.853010:0:14269:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.853015:0:14269:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790920642.853028:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.853034:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff88eb41e36800/0x2a4915844546b1d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2a4915844546b1e0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.853050:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920642.853052:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920642.853054:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920642.853076:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b6dbfc26-a70a-426c-a856-613d861b9981:3305:1877915972249472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920642.853107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920642.853148:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972249728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920642.853166:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb05629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972249600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790920642.853174:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920642.853208:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920642.853227:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249472 00000100:00100000:0.0:1790920642.853232:0:14265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249472 00000100:00100000:2.0:1790920642.853252:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249728 00010000:00010000:0.0:1790920642.853254:0:14265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b35a expref: 19 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.853258:0:14266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249728 00000100:00100000:0.0:1790920642.853276:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249600 00000100:00100000:0.0:1790920642.853280:0:14265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249600 00010000:00010000:1.0:1790920642.853287:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790920642.853289:0:14266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 21 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920642.853296:0:14265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b226 expref: 21 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920642.853316:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920642.853326:0:14266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6dbfc26-a70a-426c-a856-613d861b9981+21:3305:x1877915972249472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790920642.853336:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920642.853341:0:14266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b35a expref: 21 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853351:0:14266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546b35a expref: 21 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853365:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3ae52000/0x2a4915844546b361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546b35a expref: 21 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853384:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920642.853416:0:14266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6dbfc26-a70a-426c-a856-613d861b9981+20:3305:x1877915972249472:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920642.853424:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790920642.853445:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920642.853453:0:14266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6dbfc26-a70a-426c-a856-613d861b9981+19:3307:x1877915972249728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790920642.853461:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920642.853465:0:14266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 19 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853486:0:14266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 19 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853507:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3443d000/0x2a4915844546b1e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546b1d9 expref: 19 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853516:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920642.853556:0:14266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6dbfc26-a70a-426c-a856-613d861b9981+18:3307:x1877915972249728:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920642.853562:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790920642.853578:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790920642.853587:0:14266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6dbfc26-a70a-426c-a856-613d861b9981+17:3306:x1877915972249600:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920642.853591:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972249728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790920642.853596:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920642.853602:0:14266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2a4915844546b226 expref: 17 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853611:0:14266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2a4915844546b226 expref: 17 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853628:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3443d800/0x2a4915844546b22d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2a4915844546b226 expref: 17 pid: 14275 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.853637:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920642.853674:0:14266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6dbfc26-a70a-426c-a856-613d861b9981+16:3306:x1877915972249600:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920642.853680:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790920642.853735:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb05629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b6dbfc26-a70a-426c-a856-613d861b9981:3306:1877915972249600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790920642.854822:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb0562b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b6dbfc26-a70a-426c-a856-613d861b9981:3305:1877915972249472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790920642.855610:0:16400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972248832:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920642.855956:0:16400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16400:1877915972248960:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920642.855990:0:16400:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920642.857087:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920642.857123:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920642.857421:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282688 00000100:00100000:1.0:1790920642.857429:0:14267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282688 00010000:00010000:1.0:1790920642.857475:0:14267:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 13 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920642.857509:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282816 00000100:00100000:1.0:1790920642.857511:0:14267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282816 00010000:00010000:1.0:1790920642.857525:0:14267:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 14 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920642.857537:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1790920642.857545:0:14267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:574fd940-44bf-4bed-b114-917b4fd5a50a+14:2355:x1877915951282688:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920642.857558:0:14267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920642.857563:0:14267:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 14 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857574:0:14267:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 14 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857622:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb07a52a00/0x2a4915844546b4bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeec expref: 14 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857637:0:14267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920642.857700:0:14267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:574fd940-44bf-4bed-b114-917b4fd5a50a+13:2355:x1877915951282688:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 155us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920642.857718:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1790920642.857804:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:1.0:1790920642.857812:0:14267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:574fd940-44bf-4bed-b114-917b4fd5a50a+12:2355:x1877915951282816:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920642.857821:0:14267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920642.857825:0:14267:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 12 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857835:0:14267:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 12 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857848:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb3ae52800/0x2a4915844546b487 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edae8a expref: 12 pid: 14273 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857859:0:14267:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857868:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857882:0:14267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857899:0:14267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857906:0:14267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857913:0:14267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857919:0:14267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920642.857923:0:14267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.857978:0:14267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.858003:0:14267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920642.858013:0:14267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920642.858041:0:14267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:574fd940-44bf-4bed-b114-917b4fd5a50a+11:2355:x1877915951282816:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 229us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920642.858048:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00010000:00010000:2.0:1790920642.858440:0:16400:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.858452:0:16400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920642.858459:0:16400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88eb41e37e00/0x2a4915844546b4e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920643.304937:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920643.692156:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972249856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920643.692233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920643.697502:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249856 00000100:00100000:2.0:1790920643.697519:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249856 00000100:00100000:2.0:1790920643.697588:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790920643.697600:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972249856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920643.697642:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920643.697764:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972249856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (5510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920643.697772:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790920643.697840:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972249856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790920644.043291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920644.043382:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951282944 00000100:00100000:3.0:1790920644.043392:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951282944 00000100:00100000:3.0:1790920644.043451:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:3.0:1790920644.043462:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+11:13732:x1877915951282944:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920644.043479:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920644.043511:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb07a52c00/0x2a4915844546b4f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf1d expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.043539:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb07a52c00/0x2a4915844546b4f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf1d expref: 12 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.043551:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb07a52c00/0x2a4915844546b4f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf1d expref: 12 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.043559:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a52c00, rc 0) 00000100:00100000:3.0:1790920644.043842:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13732:x1877915951282944:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 382us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920644.043850:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:1.0:1790920644.046651:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920644.047117:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283072 00000100:00100000:3.0:1790920644.047129:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283072 00000100:00100000:3.0:1790920644.047223:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:3.0:1790920644.047234:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13732:x1877915951283072:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.047549:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13732:x1877915951283072:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 316us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920644.047558:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:0.0:1790920644.050941:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920644.050987:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283200 00000100:00100000:3.0:1790920644.050997:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283200 00000100:00100000:3.0:1790920644.051051:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:3.0:1790920644.051062:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13732:x1877915951283200:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.051741:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13732:x1877915951283200:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 232us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920644.051774:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:2.0:1790920644.062118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920644.062694:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283328 00000100:00100000:1.0:1790920644.062704:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283328 00000100:00100000:1.0:1790920644.062777:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:1.0:1790920644.062797:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+12:13732:x1877915951283328:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920644.063365:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920644.063396:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb3443ca00/0x2a4915844546b4f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf24 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920644.063427:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb3443ca00/0x2a4915844546b4f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf24 expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920644.063439:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb3443ca00/0x2a4915844546b4f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf24 expref: 13 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920644.063448:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443ca00, rc 0) 00000100:00100000:1.0:1790920644.063518:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13732:x1877915951283328:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 731us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920644.063525:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:3.0:1790920644.070944:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920644.076612:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283456 00000100:00100000:1.0:1790920644.076624:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283456 00000100:00100000:1.0:1790920644.076696:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 110 00000100:00100000:1.0:1790920644.076707:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13732:x1877915951283456:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.077336:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13732:x1877915951283456:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 628us (6394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920644.077347:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 110 00000100:00100000:0.0:1790920644.082488:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920644.082604:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283584 00000100:00100000:1.0:1790920644.082615:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283584 00000100:00100000:1.0:1790920644.082675:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 111 00000100:00100000:1.0:1790920644.082698:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13732:x1877915951283584:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920644.083387:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:13732:x1877915951283584:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 688us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920644.083398:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 111 10000000:01000000:1.0:1790920644.268696:0:14277:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790920644.268703:0:14277:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb32dc3800 from 10 10000000:01000000:1.0:1790920644.268709:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790920644.268962:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3443cc00/0x2a4915844546b4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920644.268982:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb3443cc00/0x2a4915844546b4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920644.268995:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb3443cc00/0x2a4915844546b4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920644.269023:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972249984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790920644.269097:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920644.269152:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920644.269280:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972249984 00000100:00100000:2.0:1790920644.269287:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972249984 00000100:00100000:2.0:1790920644.269344:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790920644.269354:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+16:14277:x1877915972249984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920644.269368:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920644.269383:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36600/0x2a4915844546b505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b4fe expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.269410:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36600/0x2a4915844546b505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b4fe expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.269422:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36600/0x2a4915844546b505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b4fe expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.269430:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36600, rc 0) 00000100:00100000:2.0:1790920644.269473:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+17:14277:x1877915972249984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920644.269479:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790920644.269921:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972249984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790920644.269940:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb3443cc00/0x2a4915844546b4fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b505 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920644.269950:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb3443cc00/0x2a4915844546b4fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b505 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920644.270019:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920644.270055:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920644.270083:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920644.270893:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972250112 00000100:00100000:2.0:1790920644.270901:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972250112 00000100:00100000:2.0:1790920644.270948:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790920644.270958:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+17:14277:x1877915972250112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920644.271732:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+17:14277:x1877915972250112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 773us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920644.271742:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790920644.272733:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790920644.272897:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790920644.272954:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920644.272989:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920644.273490:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972250240 00000100:00100000:2.0:1790920644.273498:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972250240 00000100:00100000:2.0:1790920644.273541:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790920644.273549:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+17:14277:x1877915972250240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790920644.274475:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+17:14277:x1877915972250240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 922us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920644.274485:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790920644.277296:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790920644.283110:0:16465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790920644.288295:0:14277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790920644.288338:0:14277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790920644.288351:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb3443cc00/0x2a4915844546b4fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b505 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.288365:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb3443cc00/0x2a4915844546b4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b505 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790920644.288573:0:14277:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790920644.288577:0:14277:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3a4cd800 from 10 10000000:01000000:3.0:1790920644.288581:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790920644.288621:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb07a52a00/0x2a4915844546b50c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.288639:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb07a52a00/0x2a4915844546b50c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.288650:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb07a52a00/0x2a4915844546b50c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920644.288687:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.288794:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920644.288839:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb106a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1790920644.288922:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972250368 00000100:00100000:2.0:1790920644.288929:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972250368 00000100:00100000:2.0:1790920644.290125:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790920644.290140:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+17:14277:x1877915972250368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790920644.290156:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920644.290185:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb41e36800/0x2a4915844546b513 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b50c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.290211:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb41e36800/0x2a4915844546b513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b50c expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.290222:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb41e36800/0x2a4915844546b513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b50c expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.290244:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36800, rc 0) 00000100:00100000:2.0:1790920644.290309:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+18:14277:x1877915972250368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920644.290318:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790920644.291856:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920644.291885:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb07a52a00/0x2a4915844546b50c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b513 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.291897:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb07a52a00/0x2a4915844546b50c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b513 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920644.291974:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.292036:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920644.295793:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb106a5000 going to sleep for 11 seconds 00000100:00100000:0.0:1790920644.296960:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972250496 00000100:00100000:0.0:1790920644.296974:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972250496 00000100:00100000:0.0:1790920644.297031:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790920644.297041:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+18:14277:x1877915972250496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790920644.299058:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+18:14277:x1877915972250496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2009us (7012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920644.299071:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790920644.301009:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.301074:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.301143:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920644.301440:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb106a5000 going to sleep for 11 seconds 00000100:00100000:0.0:1790920644.301486:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972250624 00000100:00100000:0.0:1790920644.301494:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972250624 00000100:00100000:0.0:1790920644.301596:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790920644.301607:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+18:14277:x1877915972250624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790920644.302141:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b6dbfc26-a70a-426c-a856-613d861b9981+18:14277:x1877915972250624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 535us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920644.302150:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790920644.302411:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790920644.303257:0:16467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790920644.303531:0:14277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790920644.303551:0:14277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790920644.303562:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb07a52a00/0x2a4915844546b50c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b513 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.303574:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb07a52a00/0x2a4915844546b50c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b513 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790920644.303587:0:14277:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790920644.303589:0:14277:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88eb3f5e5000 from 10 10000000:01000000:2.0:1790920644.303592:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790920644.303628:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546b51a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.303636:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546b51a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920644.303646:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546b51a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920644.303670:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34252680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790920644.303732:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920644.303802:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05fee000 going to sleep for 11 seconds 00000100:00100000:3.0:1790920644.303955:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972250752 00000100:00100000:3.0:1790920644.303961:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972250752 00000100:00100000:3.0:1790920644.304005:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790920644.304014:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+18:14277:x1877915972250752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920644.304026:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920644.304039:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88eb07a53e00/0x2a4915844546b521 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a4915844546b51a expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.304060:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88eb07a53e00/0x2a4915844546b521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2a4915844546b51a expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.304070:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88eb07a53e00/0x2a4915844546b521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2a4915844546b51a expref: 19 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.304078:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a53e00, rc 0) 00000100:00100000:3.0:1790920644.304120:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972250752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920644.304127:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790920644.304284:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34252680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790920644.304302:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546b51a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b521 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920644.304310:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546b51a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2a4915844546b521 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920644.304360:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.304388:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920644.304411:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0db44c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920644.304451:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972250880 00000100:00100000:2.0:1790920644.304460:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972250880 00000100:00100000:2.0:1790920644.304495:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790920644.304503:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972250880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790920644.304978:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972250880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 475us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920644.304987:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790920644.305158:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972250880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.305319:0:14277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972251008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790920644.305361:0:14277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920644.305390:0:14277:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0db44c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790920644.305432:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972251008 00000100:00100000:2.0:1790920644.305437:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972251008 00000100:00100000:2.0:1790920644.305471:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790920644.305478:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972251008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790920644.307480:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:14277:x1877915972251008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1993us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920644.307495:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790920644.308286:0:14277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b6dbfc26-a70a-426c-a856-613d861b9981:14277:1877915972251008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790920644.310693:0:16468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790920644.311016:0:14277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790920644.311037:0:14277:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790920644.311049:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546b51a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b521 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920644.311062:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff88eb41e37200/0x2a4915844546b51a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2a4915844546b521 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920644.329018:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920645.353294:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790920645.738348:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790920645.777949:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920645.778006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920645.778039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920645.778091:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920645.778113:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920645.778129:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920645.778148:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920645.778182:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283968 00000100:00100000:0.0:1790920645.778193:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283968 00000100:00100000:0.0:1790920645.778254:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951284096 00000100:00100000:0.0:1790920645.778257:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951284096 00000100:00100000:0.0:1790920645.778267:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951284352 00000100:00100000:0.0:1790920645.778269:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951284352 00000100:00100000:0.0:1790920645.778279:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951284480 00000100:00100000:0.0:1790920645.778281:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951284480 00000100:00100000:0.0:1790920645.778297:0:16162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920645.778307:0:16162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2354:x1877915951283968:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920645.778542:0:16162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2354:x1877915951283968:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 235us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920645.778551:0:16162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920645.778574:0:16162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1790920645.778580:0:16162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2354:x1877915951284096:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920645.778604:0:16162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2354:x1877915951284096:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920645.778610:0:16162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1790920645.778621:0:16162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:0.0:1790920645.778626:0:16162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2354:x1877915951284352:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920645.778657:0:16162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2354:x1877915951284352:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 21us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920645.778675:0:16162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:0.0:1790920645.778687:0:16162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:0.0:1790920645.778693:0:16162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2354:x1877915951284480:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920645.778717:0:16162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2354:x1877915951284480:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920645.778724:0:16162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00080000:0.0:1790920645.778783:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790920645.778788:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920645.778793:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283712 00000100:00100000:3.0:1790920645.778797:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283712 00000100:00100000:3.0:1790920645.778830:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:3.0:1790920645.778836:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3c7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:2354:x1877915951283712:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920645.778866:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3c7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:574fd940-44bf-4bed-b114-917b4fd5a50a+13:2354:x1877915951283712:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 30us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920645.778872:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:2.0:1790920645.779008:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951283840 00000100:00100000:2.0:1790920645.779014:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951283840 00000100:00100000:2.0:1790920645.779066:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951284224 00000100:00100000:2.0:1790920645.779070:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951284224 00000100:00100000:2.0:1790920645.779092:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:2.0:1790920645.779099:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2354:x1877915951283840:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920645.779120:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:0.0:1790920645.779128:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb0562aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2354:x1877915951284224:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920645.779136:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2354:x1877915951283840:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 38us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920645.779142:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1790920645.779157:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb0562aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2354:x1877915951284224:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 30us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920645.779163:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00080000:3.0:1790920645.779234:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790920646.378930:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790920646.519727:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920646.519920:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951284608 00000100:00100000:2.0:1790920646.519934:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951284608 00000100:00100000:2.0:1790920646.520013:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:2.0:1790920646.520025:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:14386:x1877915951284608:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920646.520055:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920646.520099:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf2b expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520184:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520202:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520217:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520234:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520253:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520261:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520942:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546b53d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520955:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546b53d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.520964:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546b53d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920646.520997:0:14280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790920646.521001:0:14280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920646.521047:0:14280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546b53d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521066:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521073:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521081:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521087:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920646.521092:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521100:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521115:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:2.0:1790920646.521118:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920646.521123:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521129:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b52f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521142:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521149:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521154:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521165:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920646.521169:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521175:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521183:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88eb06297400) 00010000:00010000:2.0:1790920646.521185:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920646.521188:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521195:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b536 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.521240:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf2b expref: 8 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.522549:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36000/0x2a4915844546b53d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf2b expref: 7 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.522560:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88eb06297700) 00010000:00010000:2.0:1790920646.522564:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920646.522567:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36000, rc 0) 00000100:00100000:2.0:1790920646.525904:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+7:14386:x1877915951284608:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 5861us (6173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920646.525921:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:3.0:1790920646.529053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.529564:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951284864 00000100:00100000:0.0:1790920646.529580:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951284864 00000100:00100000:0.0:1790920646.529671:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1790920646.529683:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+7:14386:x1877915951284864:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920646.529710:0:14281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920646.529742:0:14281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b544 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf32 expref: -99 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.529894:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.529938:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.529954:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.530186:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.530213:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.530227:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.530692:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b559 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.530703:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.530712:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920646.530724:0:14281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790920646.530985:0:14281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.530993:0:14281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531126:0:14281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531140:0:14281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920646.531145:0:14281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531152:0:14281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531166:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88eb06297700) 00010000:00010000:0.0:1790920646.531170:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.531175:0:14281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531182:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b54b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531194:0:14281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531200:0:14281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531206:0:14281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531212:0:14281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920646.531215:0:14281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531220:0:14281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531239:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88eb0856f700) 00010000:00010000:0.0:1790920646.531242:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.531245:0:14281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.531252:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b552 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.532339:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b544 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf32 expref: 10 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.532365:0:14281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52c00/0x2a4915844546b559 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf32 expref: 9 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.532374:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb0856fe00) 00010000:00010000:0.0:1790920646.532377:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.532380:0:14281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52c00, rc 0) 00000100:00100000:0.0:1790920646.534796:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14386:x1877915951284864:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 5099us (5742us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790920646.534813:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1790920646.545450:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920646.545879:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951284992 00000100:00100000:2.0:1790920646.546041:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951284992 00000100:00100000:2.0:1790920646.546484:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1790920646.546499:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14386:x1877915951284992:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790920646.546889:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14386:x1877915951284992:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 Request processed in 383us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920646.546909:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:3.0:1790920646.670874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920646.671950:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951285120 00000100:00100000:1.0:1790920646.671972:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951285120 00000100:00100000:1.0:1790920646.672130:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:1.0:1790920646.672143:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14392:x1877915951285120:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920646.672172:0:16156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920646.672200:0:16156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546b567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf39 expref: -99 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672298:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672318:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672364:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672388:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672396:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672404:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672915:0:16156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672926:0:16156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672934:0:16156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672953:0:16156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920646.672958:0:16156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672968:0:16156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.672983:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:1.0:1790920646.672987:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920646.672993:0:16156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673000:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b56e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673017:0:16156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673024:0:16156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673030:0:16156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673035:0:16156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920646.673038:0:16156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673045:0:16156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673063:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88eb0850ea00) 00010000:00010000:1.0:1790920646.673066:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920646.673069:0:16156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673075:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b575 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673121:0:16156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546b567 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf39 expref: 10 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673133:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:1.0:1790920646.673135:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920646.673139:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546b567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf39 expref: 10 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.673149:0:16156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d800, rc 0) 00000100:00100000:1.0:1790920646.673253:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14392:x1877915951285120:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1112us (2393us total) trans 0 rc 301/301 00000100:00100000:1.0:1790920646.673262:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:3.0:1790920646.684133:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.684657:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951285248 00000100:00100000:0.0:1790920646.684672:0:14289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951285248 00000100:00100000:0.0:1790920646.685012:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1790920646.685026:0:14289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14392:x1877915951285248:12345-192.168.204.34@tcp:700:lfs.0 00000100:00100000:0.0:1790920646.685139:0:14289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14392:x1877915951285248:12345-192.168.204.34@tcp:700:lfs.0 Request processed in 116us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920646.685161:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:2.0:1790920646.696619:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.696907:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951285504 00000100:00100000:0.0:1790920646.696921:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951285504 00000100:00100000:0.0:1790920646.697002:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:0.0:1790920646.697014:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14392:x1877915951285504:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:0.0:1790920646.697092:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920646.697128:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b4aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaeb4 expref: 9 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.697151:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:0.0:1790920646.697157:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920646.698123:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.698149:0:14280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 5 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.698160:0:14280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.698205:0:14280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 5 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.698225:0:14280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 5 pid: 16156 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920646.698253:0:14280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14280:1877915972251136:192.168.204.34@tcp:104: 00000100:00100000:0.0:1790920646.698400:0:14280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb02d40000 going to sleep for 11 seconds 00000100:00100000:3.0:1790920646.703131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.703250:0:14280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14280:1877915972251136:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920646.703288:0:14280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920646.703373:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951285632 00000100:00100000:1.0:1790920646.703383:0:14267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951285632 00010000:00010000:1.0:1790920646.703432:0:14267:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 6 pid: 16156 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920646.703476:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:1.0:1790920646.703486:0:14267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2354:x1877915951285632:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920646.703524:0:14267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920646.703531:0:14267:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 6 pid: 16156 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.703546:0:14267:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 6 pid: 16156 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.703574:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b4e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf16 expref: 6 pid: 16156 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.703594:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:1.0:1790920646.703600:0:14267:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.703611:0:14267:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.703620:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.703668:0:14267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920646.703788:0:14267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2354:x1877915951285632:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 301us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920646.703795:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00010000:00010000:2.0:1790920646.704365:0:14280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.704376:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.704407:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.704420:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.704430:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920646.716475:0:14280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790920646.716505:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.716519:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.716527:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.716555:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:2.0:1790920646.716560:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.716569:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.716591:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb06297800) 00010000:00010000:2.0:1790920646.716594:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790920646.716600:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.716606:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52e00/0x2a4915844546b57c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920646.716947:0:14280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fd97cc9 reply state 000000009c0697a9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920646.716961:0:14280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790920646.717111:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+10:14392:x1877915951285504:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 20091us (20554us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790920646.717121:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00010000:00010000:0.0:1790920646.725266:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.725290:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.725300:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.725308:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb41e37600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920646.725313:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.725323:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.725344:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88eb06297400) 00010000:00010000:0.0:1790920646.725348:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.725355:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.725372:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b583 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920646.762077:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790920646.849722:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.849920:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951285760 00000100:00100000:0.0:1790920646.849953:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951285760 00000100:00100000:0.0:1790920646.850026:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:0.0:1790920646.850038:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+9:14400:x1877915951285760:12345-192.168.204.34@tcp:101:lctl.0 00010000:00010000:0.0:1790920646.850071:0:14281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920646.850102:0:14281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b58a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf40 expref: -99 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.850185:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b591 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.850201:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.850216:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920646.850269:0:14281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790920646.850274:0:14281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920646.850318:0:14281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.850347:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b58a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf40 expref: 11 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.850479:0:14281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53000/0x2a4915844546b591 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf40 expref: 10 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.850490:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:0.0:1790920646.850493:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920646.850498:0:14281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53000, rc 0) 00000100:00100000:0.0:1790920646.850591:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+10:14400:x1877915951285760:12345-192.168.204.34@tcp:101:lctl.0 Request processed in 554us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920646.850599:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1790920646.887715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920646.887998:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951285888 00000100:00100000:2.0:1790920646.888012:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951285888 00000100:00100000:2.0:1790920646.888096:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:2.0:1790920646.888109:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+5:14401:x1877915951285888:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920646.888137:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920646.888175:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf47 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.888299:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b59f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.888318:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.888331:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920646.888386:0:14282:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790920646.888391:0:14282:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920646.888414:0:14282:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.888443:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf47 expref: 7 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.888466:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37600/0x2a4915844546b59f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf47 expref: 6 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.888476:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:2.0:1790920646.888479:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790920646.888483:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37600, rc 0) 00000100:00100000:2.0:1790920646.888570:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+6:14401:x1877915951285888:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 464us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920646.888578:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:3.0:1790920646.894263:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.898662:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951286016 00000100:00100000:0.0:1790920646.898687:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951286016 00000100:00100000:0.0:1790920646.899437:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:0.0:1790920646.899451:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+6:14401:x1877915951286016:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920646.899478:0:14281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920646.899506:0:14281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf4e expref: -99 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.899592:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.899609:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.899635:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.899654:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.899661:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.899668:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.901109:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b5bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.901148:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.901162:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920646.901210:0:14281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790920646.901214:0:14281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920646.901233:0:14281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.901246:0:14281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.901252:0:14281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.901259:0:14281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.901265:0:14281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920646.902334:0:14281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902350:0:14281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902367:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:0.0:1790920646.902370:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.902376:0:14281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902399:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902417:0:14281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902422:0:14281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902429:0:14281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902434:0:14281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920646.902438:0:14281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902444:0:14281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902451:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88eb0856f600) 00010000:00010000:0.0:1790920646.902454:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.902457:0:14281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902463:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902514:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf4e expref: 8 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902542:0:14281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b5bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf4e expref: 7 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.902550:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:0.0:1790920646.902552:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790920646.902555:0:14281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52000, rc 0) 00000100:00100000:0.0:1790920646.902651:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+7:14401:x1877915951286016:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 3203us (8403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920646.902661:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:3.0:1790920646.911956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920646.912104:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951286272 00000100:00100000:2.0:1790920646.912129:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951286272 00000100:00100000:2.0:1790920646.912220:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:2.0:1790920646.912233:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+7:14401:x1877915951286272:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1790920646.912261:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920646.912289:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b5c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf55 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920646.912434:0:14282:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790920646.912601:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b5c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf55 expref: 9 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.912618:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:2.0:1790920646.912621:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790920646.912638:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b5c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf55 expref: 9 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920646.912656:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37a00, rc 0) 00000100:00100000:2.0:1790920646.912734:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b496f1b-f428-4353-85dd-ead3c534fea1+8:14401:x1877915951286272:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 504us (793us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1790920646.912742:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:1.0:1790920646.923736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.928495:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951286528 00000100:00100000:0.0:1790920646.928514:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951286528 00000100:00100000:0.0:1790920646.928607:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:0.0:1790920646.928618:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+8:14401:x1877915951286528:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:0.0:1790920646.928690:0:16156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920646.928719:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b5bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf4e expref: 8 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.928742:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:0.0:1790920646.930373:0:16156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790920646.930413:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.930431:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.930443:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920646.930716:0:16156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f0446c0 reply state 00000000d92ef47e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920646.930727:0:16156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790920646.930736:0:16156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790920646.935192:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+9:14401:x1877915951286528:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 6563us (11454us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790920646.935205:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:3.0:1790920646.943183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920646.943258:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951286784 00000100:00100000:2.0:1790920646.943391:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951286784 00000100:00100000:2.0:1790920646.943467:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:2.0:1790920646.943478:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+9:14401:x1877915951286784:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1790920646.944086:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+10:14401:x1877915951286784:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 608us (915us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790920646.944095:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00010000:00010000:1.0:1790920646.947163:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.947210:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.947220:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.947227:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920646.947233:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.947243:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.947267:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb0856f600) 00010000:00010000:1.0:1790920646.947270:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790920646.947277:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920646.947284:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b5d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920646.956995:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920646.957130:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951287040 00000100:00100000:0.0:1790920646.957145:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951287040 00000100:00100000:0.0:1790920646.957229:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1790920646.957241:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+9:14401:x1877915951287040:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920646.957273:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920646.957301:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf5c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957408:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957431:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957446:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957478:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957488:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957515:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920646.957681:0:14280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790920646.957851:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957861:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957869:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957876:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920646.957882:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957891:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957908:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:0.0:1790920646.957912:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.957918:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957925:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b5de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957941:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957959:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957966:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957972:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920646.957975:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957983:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.957991:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88eb0856f000) 00010000:00010000:0.0:1790920646.957993:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920646.957996:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.958003:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b5e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.958054:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf5c expref: 11 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.958066:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:0.0:1790920646.958068:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920646.958072:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b5d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf5c expref: 11 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920646.958093:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53800, rc 0) 00000100:00100000:0.0:1790920646.958168:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+10:14401:x1877915951287040:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 929us (1189us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1790920646.958176:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1790920646.968146:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920646.968241:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951287168 00000100:00100000:3.0:1790920646.968256:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951287168 00000100:00100000:3.0:1790920646.968344:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:3.0:1790920646.968355:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+10:14401:x1877915951287168:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1790920646.968389:0:14281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920646.968422:0:14281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52000/0x2a4915844546b5f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf63 expref: -99 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920646.968726:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920646.968743:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920646.968797:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920646.968832:0:14281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790920646.968837:0:14281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920646.968862:0:14281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920646.968898:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52000/0x2a4915844546b5f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 12 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920646.968943:0:14281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 11 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920646.968952:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:3.0:1790920646.968956:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790920646.968960:0:14281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a53600, rc 0) 00000100:00100000:3.0:1790920646.969042:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb4189dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+11:14401:x1877915951287168:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 689us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920646.969051:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:3.0:1790920646.974871:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920646.974947:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951287296 00000100:00100000:2.0:1790920646.974979:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951287296 00000100:00100000:2.0:1790920646.975047:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:2.0:1790920646.975059:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+11:14401:x1877915951287296:12345-192.168.204.34@tcp:37:lfs.0 00000100:00100000:1.0:1790920646.993196:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+11:14401:x1877915951287296:12345-192.168.204.34@tcp:37:lfs.0 Request processed in 18120us (18439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920646.993213:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1790920647.010230:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920647.010362:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951287552 00000100:00100000:3.0:1790920647.010377:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951287552 00000100:00100000:3.0:1790920647.010485:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:3.0:1790920647.010499:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+11:14401:x1877915951287552:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1790920647.010889:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+12:14401:x1877915951287552:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 391us (672us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1790920647.010898:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00080000:0.0:1790920647.011445:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920647.111945:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920647.112119:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951287680 00000100:00100000:0.0:1790920647.112133:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951287680 00000100:00100000:0.0:1790920647.112279:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:0.0:1790920647.112292:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+10:14407:x1877915951287680:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920647.112318:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920647.112345:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf6a expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112430:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112448:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112476:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112496:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112503:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112529:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112672:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b616 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112682:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112690:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920647.112723:0:14280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790920647.112728:0:14280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920647.112826:0:14280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b616 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112842:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112849:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112858:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112864:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920647.112870:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112879:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112901:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:0.0:1790920647.112904:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920647.112912:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112919:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112935:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112942:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112948:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112955:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920647.112958:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112964:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112971:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88eb0856f000) 00010000:00010000:0.0:1790920647.112974:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920647.112977:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.112983:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b60f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.113032:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf6a expref: 12 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.113047:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53e00/0x2a4915844546b616 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf6a expref: 11 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.113055:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:0.0:1790920647.113057:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790920647.113060:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53e00, rc 0) 00000100:00100000:0.0:1790920647.113135:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14407:x1877915951287680:12345-192.168.204.34@tcp:101:bash.0 Request processed in 846us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920647.113144:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00080000:3.0:1790920647.113930:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920647.117868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.118194:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951287936 00000100:00100000:1.0:1790920647.118209:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951287936 00000100:00100000:1.0:1790920647.118477:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:1.0:1790920647.118490:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14407:x1877915951287936:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1790920647.118518:0:16156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920647.118561:0:16156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546b61d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf71 expref: -99 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.118775:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.118795:0:16156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 11 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.118804:0:16156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.118848:0:16156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 11 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.118862:0:16156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 11 pid: 14281 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920647.118876:0:16156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33ffbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16156:1877915972251264:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920647.119008:0:16156:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb067e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920647.125703:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.125822:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951288064 00000100:00100000:1.0:1790920647.125835:0:14266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951288064 00010000:00010000:1.0:1790920647.125891:0:14266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 12 pid: 14281 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920647.125942:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1790920647.125953:0:14266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+12:2354:x1877915951288064:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920647.125970:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920647.125996:0:14266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 12 pid: 14281 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.126011:0:14266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 12 pid: 14281 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.126042:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:1.0:1790920647.126048:0:14266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.126061:0:14266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.126072:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.126097:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920647.126162:0:14266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b496f1b-f428-4353-85dd-ead3c534fea1+12:2354:x1877915951288064:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 210us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920647.126170:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00010000:00010000:0.0:1790920647.127267:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53600/0x2a4915844546b5fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf63 expref: 11 pid: 14281 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920647.127305:0:16156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33ffbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16156:1877915972251264:192.168.204.34@tcp:104: 00010000:00010000:0.0:1790920647.127339:0:16156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.127349:0:16156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.127356:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.127388:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.127415:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.127425:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128613:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128643:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128654:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920647.128668:0:16156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790920647.128705:0:16156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128713:0:16156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128720:0:16156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128727:0:16156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920647.128732:0:16156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128740:0:16156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128818:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:0.0:1790920647.128821:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920647.128828:0:16156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128835:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c800/0x2a4915844546b624 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790920647.128850:0:16156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009416f814 reply state 0000000097aae7b5 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920647.128860:0:16156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790920647.128905:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d800/0x2a4915844546b61d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 14 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128923:0:16156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 13 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.128931:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:0.0:1790920647.128933:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790920647.128935:0:16156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52000, rc 0) 00000100:00100000:0.0:1790920647.129022:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14407:x1877915951287936:12345-192.168.204.34@tcp:101:bash.0 Request processed in 10534us (11168us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790920647.129032:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 28 00010000:00010000:0.0:1790920647.134174:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.134199:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.134227:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.134363:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920647.134371:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.134381:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.134402:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88eb0856ff00) 00010000:00010000:0.0:1790920647.134406:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790920647.134413:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.134420:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b62b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920647.159869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920647.160050:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951288192 00000100:00100000:0.0:1790920647.160063:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951288192 00000100:00100000:0.0:1790920647.160350:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:0.0:1790920647.160365:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+13:14407:x1877915951288192:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1790920647.160399:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920647.160430:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b640 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf78 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.160527:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.160570:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.160585:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920647.164587:0:14282:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790920647.164599:0:14282:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790920647.164657:0:14282:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.164676:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.164717:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b640 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 15 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.164740:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 14 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.164784:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:0.0:1790920647.164788:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920647.164791:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52800, rc 0) 00000100:00100000:0.0:1790920647.164872:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14407:x1877915951288192:12345-192.168.204.34@tcp:101:bash.0 Request processed in 4510us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920647.164882:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:2.0:1790920647.173861:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920647.174025:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951288448 00000100:00100000:3.0:1790920647.174039:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951288448 00000100:00100000:3.0:1790920647.174125:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1790920647.174137:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14407:x1877915951288448:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:3.0:1790920647.174969:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+15:14407:x1877915951288448:12345-192.168.204.34@tcp:35:bash.0 Request processed in 828us (1117us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790920647.175002:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1790920647.273251:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972251520:0@lo:400:kworker.0 00000100:00100000:1.0:1790920647.273358:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920647.273432:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972252032:0@lo:400:kworker.0 00000100:00100000:1.0:1790920647.273458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920647.273496:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790920647.273502:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972251648:0@lo:400:kworker.0 00000100:00100000:1.0:1790920647.273526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790920647.273566:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972252032 00000100:00100000:1.0:1790920647.273576:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972252032 00000100:00100000:1.0:1790920647.273677:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790920647.273687:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972252032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920647.273789:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877915972252032:12345-0@lo:400:kworker.0 Request processed in 103us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920647.273797:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790920647.273843:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1877915972252032:0@lo:400:kworker.0 00000100:00100000:0.0:1790920647.274128:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972251520 00000100:00100000:0.0:1790920647.274133:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972251520 00000100:00100000:0.0:1790920647.274190:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972251648 00000100:00100000:0.0:1790920647.274202:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972251648 00000100:00100000:0.0:1790920647.274229:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790920647.274237:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972251520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920647.274300:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972251520:12345-0@lo:400:kworker.0 Request processed in 64us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920647.274307:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790920647.274324:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790920647.274331:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972251648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920647.274360:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972251648:12345-0@lo:400:kworker.0 Request processed in 31us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920647.274367:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790920647.274400:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972251648:0@lo:400:kworker.0 00000100:00100000:0.0:1790920647.274410:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972251520:0@lo:400:kworker.0 00000100:00100000:2.0:1790920647.274606:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972251776:0@lo:400:kworker.0 00000100:00100000:2.0:1790920647.274655:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920647.274689:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790920647.274705:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb4189c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972251392:0@lo:400:kworker.0 00000100:00100000:2.0:1790920647.274738:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920647.274804:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972251904:0@lo:400:kworker.0 00000100:00100000:2.0:1790920647.274826:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790920647.275001:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790920647.275008:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790920647.275011:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790920647.275023:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972251392 00000100:00100000:3.0:1790920647.275029:0:14274:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972251392 00000100:00100000:3.0:1790920647.275064:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790920647.275072:0:14274:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:3304:x1877915972251392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920647.275117:0:14274:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b6dbfc26-a70a-426c-a856-613d861b9981+19:3304:x1877915972251392:12345-0@lo:400:kworker.0 Request processed in 46us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920647.275124:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790920647.276810:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb4189c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b6dbfc26-a70a-426c-a856-613d861b9981:3304:1877915972251392:0@lo:400:kworker.0 00000100:00100000:0.0:1790920647.277020:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790920647.277039:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972252160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920647.277107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790920647.277186:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972251776 00000100:00100000:0.0:1790920647.277194:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972251776 00000100:00100000:0.0:1790920647.277257:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972251904 00000100:00100000:0.0:1790920647.277261:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972251904 00000100:00100000:1.0:1790920647.277425:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790920647.277439:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972251776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790920647.277509:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972251776:12345-0@lo:400:kworker.0 Request processed in 73us (2852us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920647.277517:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790920647.277722:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790920647.277729:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972251904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920647.277795:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877915972251904:12345-0@lo:400:kworker.0 Request processed in 66us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920647.277801:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790920647.278536:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920647.279439:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972252160 00000100:00100000:2.0:1790920647.279455:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972252160 00000100:00100000:2.0:1790920647.279536:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790920647.279548:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972252160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920647.279599:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920647.279716:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1877915972252160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920647.279722:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790920647.279807:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1877915972251904:0@lo:400:kworker.0 00000100:00100000:2.0:1790920647.279822:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972251776:0@lo:400:kworker.0 00000100:00100000:0.0:1790920647.280436:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1877915972252160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790920647.295081:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.295440:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951288704 00000100:00100000:1.0:1790920647.295840:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951288704 00000100:00100000:1.0:1790920647.295938:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:1.0:1790920647.295951:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+15:14417:x1877915951288704:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1790920647.295988:0:14281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920647.296018:0:14281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b64e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf7f expref: -99 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790920647.296157:0:14281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790920647.296696:0:14281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b64e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf7f expref: 17 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.296714:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88eb0856f700) 00010000:00010000:1.0:1790920647.296718:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790920647.296741:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b64e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf7f expref: 17 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.296787:0:14281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443c200, rc 0) 00000100:00100000:1.0:1790920647.296927:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+16:14417:x1877915951288704:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 977us (1862us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790920647.296936:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:3.0:1790920647.300199:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920647.300436:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951288960 00000100:00100000:0.0:1790920647.300450:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951288960 00000100:00100000:0.0:1790920647.300519:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1790920647.300531:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+16:14417:x1877915951288960:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1790920647.300904:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+17:14417:x1877915951288960:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 373us (721us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1790920647.300913:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:2.0:1790920647.338317:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920647.338431:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951289216 00000100:00100000:0.0:1790920647.338443:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951289216 00000100:00100000:0.0:1790920647.338538:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:0.0:1790920647.338550:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+17:14420:x1877915951289216:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1790920647.338583:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920647.338611:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b65c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf86 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.338816:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b663 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.338833:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b663 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.338847:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b663 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920647.338861:0:14282:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790920647.339034:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b65c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf86 expref: 20 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.339079:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b663 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf86 expref: 19 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.339088:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:0.0:1790920647.339092:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920647.339096:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53800, rc 0) 00000100:00100000:0.0:1790920647.339175:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+19:14420:x1877915951289216:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 627us (873us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790920647.339184:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:1.0:1790920647.341853:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920647.342158:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951289344 00000100:00100000:3.0:1790920647.342172:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951289344 00000100:00100000:3.0:1790920647.342253:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:3.0:1790920647.342266:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+19:14420:x1877915951289344:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:3.0:1790920647.342354:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342376:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342389:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342421:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342429:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342463:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342470:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920647.342475:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342484:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342499:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920647.342503:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790920647.342508:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.342514:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b671 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920647.342608:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+19:14420:x1877915951289344:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 343us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920647.342626:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:3.0:1790920647.344956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.345527:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920647.345600:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951289472 00000100:00100000:3.0:1790920647.345611:0:14265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951289472 00000100:00100000:3.0:1790920647.345693:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1790920647.345703:0:14265:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+19:2354:x1877915951289472:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790920647.345722:0:14265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790920647.345770:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53800/0x2a4915844546b663 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf86 expref: 19 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.345809:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920647.345815:0:14265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790920647.345875:0:14265:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+18:2354:x1877915951289472:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 173us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920647.345882:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1790920647.347128:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951289728 00000100:00100000:0.0:1790920647.347142:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951289728 00000100:00100000:0.0:1790920647.347248:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1790920647.347259:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+18:14420:x1877915951289728:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1790920647.347580:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+19:14420:x1877915951289728:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 321us (2633us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790920647.347589:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00010000:00010000:0.0:1790920647.401111:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920647.620602:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920647.621027:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951289984 00000100:00100000:0.0:1790920647.621037:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951289984 00000100:00100000:0.0:1790920647.621187:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:0.0:1790920647.621197:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+19:14451:x1877915951289984:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:0.0:1790920647.621232:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920647.621254:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b678 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf8d expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.621376:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b67f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.621391:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b67f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.621404:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b67f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920647.621428:0:14282:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790920647.621586:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b678 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf8d expref: 22 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.621605:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b67f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf8d expref: 21 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.621626:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:0.0:1790920647.621629:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790920647.621633:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53c00, rc 0) 00000100:00100000:0.0:1790920647.621700:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+21:14451:x1877915951289984:12345-192.168.204.34@tcp:101:cat.0 Request processed in 504us (1107us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1790920647.621707:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:2.0:1790920647.626634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.627089:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951290112 00000100:00100000:1.0:1790920647.627099:0:14267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951290112 00000100:00100000:1.0:1790920647.627159:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:1.0:1790920647.627168:0:14267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+21:2353:x1877915951290112:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920647.627183:0:14267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920647.627205:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b67f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf8d expref: 21 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.627332:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:1.0:1790920647.627338:0:14267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920647.627425:0:14267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+20:2353:x1877915951290112:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 257us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920647.627433:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:0.0:1790920647.631650:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920647.631775:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951290368 00000100:00100000:2.0:1790920647.631785:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951290368 00000100:00100000:2.0:1790920647.631843:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1790920647.631863:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+20:14451:x1877915951290368:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:2.0:1790920647.632185:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+21:14451:x1877915951290368:12345-192.168.204.34@tcp:35:cat.0 Request processed in 323us (554us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1790920647.632192:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1790920647.720570:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920647.720979:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951290624 00000100:00100000:3.0:1790920647.720990:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951290624 00000100:00100000:3.0:1790920647.721061:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:3.0:1790920647.721072:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+21:14457:x1877915951290624:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:3.0:1790920647.721096:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790920647.721118:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b68d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf94 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.721230:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.721246:0:14280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 22 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.721254:0:14280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 22 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.721262:0:14280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.721298:0:14280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 22 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.721330:0:14280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 22 pid: 14282 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920647.721346:0:14280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14280:1877915972252288:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920647.721466:0:14280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 22 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.721476:0:14280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 22 pid: 16156 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920647.721486:0:14280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14280:1877915972252416:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920647.721512:0:14280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb05feee40 going to sleep for 11 seconds 00000100:00100000:1.0:1790920647.725458:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.725508:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920647.725618:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951290752 00000100:00100000:2.0:1790920647.725627:0:14266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951290752 00010000:00010000:2.0:1790920647.725676:0:14266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 23 pid: 14282 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920647.725724:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951290880 00000100:00100000:2.0:1790920647.725728:0:14266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951290880 00010000:00010000:2.0:1790920647.725741:0:14266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 24 pid: 16156 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920647.725786:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:2.0:1790920647.725796:0:14266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+24:2355:x1877915951290752:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920647.725811:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920647.725818:0:14266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 24 pid: 14282 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726040:0:14266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 24 pid: 14282 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726066:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:2.0:1790920647.726071:0:14266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726080:0:14266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726087:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920647.726141:0:14266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+24:2355:x1877915951290752:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 346us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920647.726148:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:2.0:1790920647.726211:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:2.0:1790920647.726219:0:14266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+23:2355:x1877915951290880:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790920647.726228:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920647.726233:0:14266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 23 pid: 16156 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726243:0:14266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 23 pid: 16156 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726255:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:2.0:1790920647.726259:0:14266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726278:0:14266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726286:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.726303:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920647.726324:0:14266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+23:2355:x1877915951290880:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 106us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920647.726331:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00010000:00010000:3.0:1790920647.727768:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b647 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf78 expref: 22 pid: 14282 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920647.727793:0:14280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f571880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14280:1877915972252288:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920647.727807:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b632 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf71 expref: 21 pid: 16156 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920647.727817:0:14280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3f572a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14280:1877915972252416:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920647.727842:0:14280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.727865:0:14280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.727885:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920647.727906:0:14280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790920647.728107:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b68d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf94 expref: 22 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.728123:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52800/0x2a4915844546b694 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf94 expref: 21 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.728132:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920647.728135:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790920647.728138:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb07a52800, rc 0) 00000100:00100000:3.0:1790920647.728201:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+21:14457:x1877915951290624:12345-192.168.204.34@tcp:101:dd.0 Request processed in 7131us (7639us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1790920647.728209:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:1.0:1790920647.738998:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920647.739570:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951291136 00000100:00100000:0.0:1790920647.739580:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951291136 00000100:00100000:0.0:1790920647.739661:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:0.0:1790920647.739671:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+21:14457:x1877915951291136:12345-192.168.204.34@tcp:36:dd.0 00010000:00010000:0.0:1790920647.740150:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.740167:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920647.740179:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790920647.740256:0:14282:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1790920647.740295:0:14282:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb4ff2a reply state 00000000618c10a6 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920647.740305:0:14282:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790920647.742004:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+24:14457:x1877915951291136:12345-192.168.204.34@tcp:36:dd.0 Request processed in 2323us (3005us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1790920647.742016:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000020:00080000:0.0:1790920647.742024:0:14282:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790920647.751219:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.751317:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951291264 00000100:00100000:1.0:1790920647.751340:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951291264 00000100:00100000:1.0:1790920647.751403:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:1.0:1790920647.751414:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+24:14457:x1877915951291264:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:1.0:1790920647.751441:0:14281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920647.751464:0:14281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b6a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edaf9b expref: -99 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.751527:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b6a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf9b expref: 25 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.751542:0:14281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b6a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf9b expref: 25 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.751561:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:1.0:1790920647.751564:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790920647.751568:0:14281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443d000, rc 0) 00010000:00010000:3.0:1790920647.752339:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.752352:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.752358:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.752364:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52000 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920647.752368:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.752389:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.752404:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920647.752407:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920647.752411:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920647.752418:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52000/0x2a4915844546b6a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920647.752516:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+24:14457:x1877915951291264:12345-192.168.204.34@tcp:101:dd.0 Request processed in 1101us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920647.752524:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:0.0:1790920647.777688:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920647.777787:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951291520 00000100:00100000:2.0:1790920647.777797:0:14266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951291520 00000100:00100000:2.0:1790920647.777875:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:2.0:1790920647.777885:0:14266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+24:14457:x1877915951291520:12345-192.168.204.34@tcp:103:dd.0 00010000:00010000:2.0:1790920647.777902:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920647.777928:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443d000/0x2a4915844546b6a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edaf9b expref: 24 pid: 14281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920647.777949:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:2.0:1790920647.777954:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790920647.778013:0:14266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+23:14457:x1877915951291520:12345-192.168.204.34@tcp:103:dd.0 Request processed in 129us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920647.778020:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:0.0:1790920647.788141:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.788631:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951291648 00000100:00100000:1.0:1790920647.788642:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951291648 00000100:00100000:1.0:1790920647.788698:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:1.0:1790920647.788707:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+23:14457:x1877915951291648:12345-192.168.204.34@tcp:58:dd.0 00010000:00010000:1.0:1790920647.789006:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.789026:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.789056:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790920647.789995:0:16156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790920647.790149:0:16156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790920647.790217:0:16156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790920647.790329:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+23:14457:x1877915951291648:12345-192.168.204.34@tcp:58:dd.0 Request processed in 1619us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920647.790340:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:1.0:1790920647.797881:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920647.797935:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951291776 00000100:00100000:1.0:1790920647.797945:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951291776 00000100:00100000:1.0:1790920647.797999:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:1.0:1790920647.798011:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+23:14457:x1877915951291776:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:1.0:1790920647.798033:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790920647.798057:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edafa2 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.798111:0:14280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.798121:0:14280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa2 expref: 24 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.798140:0:14280:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.798152:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa2 expref: 24 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.798164:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:1.0:1790920647.798167:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790920647.798171:0:14280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa2 expref: 24 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920647.798193:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3443da00, rc 0) 00000100:00100000:1.0:1790920647.799522:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+24:14457:x1877915951291776:12345-192.168.204.34@tcp:101:dd.0 Request processed in 1505us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920647.799533:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000001:00080000:1.0:1790920647.829908:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:1.0:1790920647.829937:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1790920647.830624:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1790920648.427097:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920648.809898:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790920648.809923:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb34250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972252544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790920648.810007:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920648.810132:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972252544 00000100:00100000:2.0:1790920648.810139:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972252544 00000100:00100000:2.0:1790920648.810199:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790920648.810210:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972252544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920648.810265:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920648.810323:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877915972252544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920648.810330:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000040:00080000:0.0:1790920648.812259:0:14311:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790920648.812267:0:14311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920648.812329:0:14311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790920648.812338:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790920648.812461:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3af13800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14311:1877915972252672:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790920648.812558:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb0720a300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920648.812685:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb34250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1877915972252544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790920648.817110:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3af13800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14311:1877915972252672:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790920648.821134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920648.821815:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951291904 00000100:00100000:0.0:1790920648.821839:0:14291:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951291904 00000100:00100000:0.0:1790920648.821899:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1790920648.821911:0:14291:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14458:x1877915951291904:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790920648.822009:0:14291:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14458:x1877915951291904:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 Request processed in 99us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920648.822017:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1790920648.826561:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920648.829432:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951292032 00000100:00100000:0.0:1790920648.829451:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951292032 00000100:00100000:0.0:1790920648.829539:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:0.0:1790920648.829552:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14458:x1877915951292032:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790920648.829601:0:14282:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790920648.829813:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14458:x1877915951292032:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 262us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920648.829822:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:1.0:1790920648.855384:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920648.855623:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951292160 00000100:00100000:3.0:1790920648.855635:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951292160 00000100:00100000:3.0:1790920648.855703:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:3.0:1790920648.855714:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14458:x1877915951292160:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790920648.855817:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.855845:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.855860:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.855938:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.855947:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.855954:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.855996:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856006:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856013:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790920648.856051:0:14280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790920648.856056:0:14280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790920648.856073:0:14280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856084:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856090:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856097:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856103:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920648.856107:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856114:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856124:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb0856fe00) 00010000:00010000:3.0:1790920648.856133:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920648.856138:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856144:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53a00/0x2a4915844546b6be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856158:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856163:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856168:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856173:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920648.856176:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856181:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856189:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff88eb04d19b00) 00010000:00010000:3.0:1790920648.856191:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920648.856194:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856199:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b6c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.856213:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.857249:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.857267:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.857273:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53400 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920648.857277:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.857284:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.857296:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920648.857298:0:14280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920648.857301:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.857307:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53400/0x2a4915844546b6cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920648.857411:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14458:x1877915951292160:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 1695us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920648.857421:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:3.0:1790920648.862085:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920648.862177:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951292416 00000100:00100000:0.0:1790920648.862188:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951292416 00000100:00100000:0.0:1790920648.862251:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:0.0:1790920648.862262:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+11:14458:x1877915951292416:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920648.862284:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920648.862320:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b6d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edafa9 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862422:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862438:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862449:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790920648.862462:0:14282:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790920648.862609:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862618:0:14282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862625:0:14282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862631:0:14282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae53a00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920648.862635:0:14282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862643:0:14282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862655:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:0.0:1790920648.862658:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790920648.862663:0:14282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862679:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b6da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862721:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b6d3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa9 expref: 13 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862732:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88eb0856fe00) 00010000:00010000:0.0:1790920648.862734:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790920648.862738:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae52800/0x2a4915844546b6d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa9 expref: 13 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.862786:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae52800, rc 0) 00000100:00100000:0.0:1790920648.862976:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+12:14458:x1877915951292416:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 715us (901us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1790920648.862984:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:2.0:1790920648.867804:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920648.868101:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951292544 00000100:00100000:1.0:1790920648.868113:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951292544 00000100:00100000:1.0:1790920648.868181:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:1.0:1790920648.868193:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+12:14458:x1877915951292544:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790920648.868230:0:14281:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790920648.868351:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+12:14458:x1877915951292544:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 160us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920648.868360:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:1.0:1790920648.878005:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920648.878134:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951292800 00000100:00100000:2.0:1790920648.878145:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951292800 00000100:00100000:2.0:1790920648.878265:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:2.0:1790920648.878277:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+12:14458:x1877915951292800:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920648.878301:0:16156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920648.878328:0:16156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b6e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edafb0 expref: -99 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790920648.880384:0:16156:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1790920648.880396:0:16156:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1790920648.880449:0:16156:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1790920648.880778:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b6ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.880795:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b6ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.880808:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b6ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.882177:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b6e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafb0 expref: 15 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.882220:0:16156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b6ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafb0 expref: 14 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.882231:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb06297e00) 00010000:00010000:2.0:1790920648.882235:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790920648.882239:0:16156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37a00, rc 0) 00000100:00100000:2.0:1790920648.882322:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14458:x1877915951292800:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 4046us (4327us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790920648.882331:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:2.0:1790920648.895992:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920648.896076:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951293056 00000100:00100000:1.0:1790920648.896087:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951293056 00000100:00100000:1.0:1790920648.896207:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:1.0:1790920648.896230:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14458:x1877915951293056:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790920648.896287:0:14281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920648.896313:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b6ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafb0 expref: 14 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896332:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb06297e00) 00010000:00010000:1.0:1790920648.896342:0:14281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790920648.896362:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896375:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896385:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896425:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896433:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896439:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896650:0:14281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896658:0:14281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896686:0:14281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896693:0:14281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443dc00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920648.896697:0:14281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896704:0:14281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896712:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88eb04d19e00) 00010000:00010000:1.0:1790920648.896715:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920648.896719:0:14281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896724:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443dc00/0x2a4915844546b6fd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896735:0:14281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896741:0:14281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896804:0:14281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896811:0:14281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c600 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920648.896814:0:14281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896841:0:14281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896851:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe8d3d5e4 (ffff88eb0850ea00) 00010000:00010000:1.0:1790920648.896853:0:14281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920648.896856:0:14281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920648.896862:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c600/0x2a4915844546b704 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe8d3d5e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920648.896944:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+13:14458:x1877915951293056:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 715us (961us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790920648.896952:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:2.0:1790920648.903061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920648.903428:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951293184 00000100:00100000:0.0:1790920648.903437:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951293184 00000100:00100000:0.0:1790920648.903541:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:0.0:1790920648.903552:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+13:14458:x1877915951293184:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790920648.903573:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790920648.903606:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b70b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edafb7 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.903655:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b712 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.903669:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b712 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.903694:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b712 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.903803:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53a00/0x2a4915844546b70b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafb7 expref: 15 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.903820:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3ae53c00/0x2a4915844546b712 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafb7 expref: 14 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.903840:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:0.0:1790920648.903843:0:14282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790920648.903847:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3ae53c00, rc 0) 00000100:00100000:0.0:1790920648.903906:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14458:x1877915951293184:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 357us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920648.903914:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:0.0:1790920648.913016:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920648.913108:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951293440 00000100:00100000:3.0:1790920648.913118:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951293440 00000100:00100000:3.0:1790920648.913172:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:3.0:1790920648.913185:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14458:x1877915951293440:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790920648.913282:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.913300:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920648.913312:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790920648.913729:0:14280:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1790920648.913739:0:14280:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 491079991884ns, next at 492079989845ns, rc = 0 00000004:00010000:3.0:1790920648.913933:0:14280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007083e010 reply state 00000000fb5d4ab4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920648.913944:0:14280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790920648.914097:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+16:14458:x1877915951293440:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 916us (1089us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1790920648.914105:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00010000:00010000:0.0:1790920648.919985:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.920005:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.920014:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.920021:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53800 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:0.0:1790920648.920027:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.920058:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.920077:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:0.0:1790920648.920081:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790920648.920086:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920648.920093:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53800/0x2a4915844546b719 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920648.920263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920648.921325:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951293568 00000100:00100000:2.0:1790920648.921338:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951293568 00000100:00100000:2.0:1790920648.921397:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:2.0:1790920648.921407:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+15:14458:x1877915951293568:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920648.921432:0:16156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920648.921452:0:16156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edafbe expref: -99 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.921509:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 16 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.921522:0:16156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 16 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.921601:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:2.0:1790920648.921604:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790920648.921607:0:16156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e36a00, rc 0) 00000100:00100000:2.0:1790920648.921670:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+16:14458:x1877915951293568:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 264us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920648.921677:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:2.0:1790920648.932073:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920648.932185:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951293696 00000100:00100000:0.0:1790920648.932272:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951293696 00000100:00100000:0.0:1790920648.932414:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1790920648.932426:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2354:x1877915951293696:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790920648.932852:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2354:x1877915951293696:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 427us (788us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790920648.932861:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00080000:1.0:1790920648.933496:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790920648.942245:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920648.942452:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951293952 00000100:00100000:2.0:1790920648.942463:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951293952 00000100:00100000:2.0:1790920648.942535:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:2.0:1790920648.942546:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+16:14458:x1877915951293952:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790920648.942853:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+17:14458:x1877915951293952:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 308us (617us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790920648.942860:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1790920648.949450:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920648.952196:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951294208 00000100:00100000:2.0:1790920648.952212:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951294208 00000100:00100000:2.0:1790920648.952354:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:2.0:1790920648.952367:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+17:14458:x1877915951294208:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790920648.952492:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+17:14458:x1877915951294208:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 128us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920648.952500:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:1.0:1790920648.965337:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920648.966100:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951294336 00000100:00100000:2.0:1790920648.966126:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951294336 00000100:00100000:2.0:1790920648.966532:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:2.0:1790920648.966567:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+17:14458:x1877915951294336:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920648.966602:0:16156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920648.966626:0:16156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b727 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edafc5 expref: -99 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.966869:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b72e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.966885:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b72e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.966897:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b72e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790920648.966937:0:16156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790920648.966957:0:16156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b72e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.966984:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37a00/0x2a4915844546b727 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafc5 expref: 19 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.967003:0:16156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b72e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafc5 expref: 18 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.967012:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:2.0:1790920648.967015:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790920648.967019:0:16156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb41e37e00, rc 0) 00000100:00100000:2.0:1790920648.967105:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+18:14458:x1877915951294336:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 541us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920648.967123:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:0.0:1790920648.972828:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920648.972969:0:14964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951294464 00000100:00100000:2.0:1790920648.972981:0:14964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951294464 00000100:00100000:2.0:1790920648.973033:0:14964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:2.0:1790920648.973055:0:14964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2354:x1877915951294464:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790920648.973075:0:14964:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790920648.973119:0:14964:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xadd38bcb46edafcc expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790920648.973145:0:14964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf47c9, blocks: 0x1 00010000:00010000:2.0:1790920648.973165:0:14964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1790920648.973169:0:14964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920648.973179:0:14964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 7 pid: 14964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.973211:0:14964:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 7 pid: 14964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920648.973225:0:14964:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88eb3a4f2800, rc 0) 00000100:00100000:2.0:1790920648.973291:0:14964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+7:2354:x1877915951294464:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 249us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920648.973299:0:14964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:3.0:1790920648.983652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920648.983720:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951294720 00000100:00100000:1.0:1790920648.983732:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951294720 00000100:00100000:1.0:1790920648.983818:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:1.0:1790920648.983941:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+18:14458:x1877915951294720:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790920648.984068:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+18:14458:x1877915951294720:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 131us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920648.988870:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:3.0:1790920648.994030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920648.994161:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951294848 00000100:00100000:0.0:1790920648.994172:0:14282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951294848 00000100:00100000:0.0:1790920648.994351:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1790920648.994363:0:14282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+18:14458:x1877915951294848:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790920649.111171:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:1.0:1790920649.115566:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1790920649.115605:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1790920649.115880:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920649.115903:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972252800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790920649.115975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920649.116092:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972252800 00000100:00100000:3.0:1790920649.116100:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972252800 00000100:00100000:3.0:1790920649.116157:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790920649.116165:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972252800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790920649.116327:0:14963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790920649.116331:0:14963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790920649.116333:0:14963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790920649.116340:0:14963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790920649 -> 1790920649 00002000:00010000:3.0:1790920649.116343:0:14963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790920649.116381:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877915972252800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (406us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1790920649.116389:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1790920649.116560:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1790920649.116611:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88eb3fe11180/2, rc 0, transno 8589934595 00000100:00100000:2.0:1790920649.116617:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972252800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790920649.117460:0:14282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14458:x1877915951294848:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 123093us (123432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920649.117471:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1790920649.125834:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.126110:0:14964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951294976 00000100:00100000:2.0:1790920649.126121:0:14964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951294976 00000100:00100000:2.0:1790920649.126176:0:14964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:2.0:1790920649.126187:0:14964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+7:2355:x1877915951294976:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790920649.126326:0:14964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+7:2355:x1877915951294976:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 141us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920649.126333:0:14964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:3.0:1790920649.130604:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.130681:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951295232 00000100:00100000:2.0:1790920649.130692:0:14281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951295232 00000100:00100000:2.0:1790920649.130795:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:2.0:1790920649.130807:0:14281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14458:x1877915951295232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790920649.130859:0:14281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790920649.131150:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e37e00/0x2a4915844546b72e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafc5 expref: 14 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.131169:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:2.0:1790920649.131175:0:14281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790920649.131218:0:14281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.131233:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.131244:0:14281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790920649.131601:0:14281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f57c0ff reply state 00000000209b9907 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920649.131612:0:14281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:1.0:1790920649.131799:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790920649.131902:0:14281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+15:14458:x1877915951295232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 1096us (1305us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1790920649.131910:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00010000:00010000:1.0:1790920649.136796:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.136813:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.136822:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.136829:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3a4f2e00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:1.0:1790920649.136833:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.136840:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.136858:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:1.0:1790920649.136861:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790920649.136866:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.136872:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f2e00/0x2a4915844546b73c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920649.147509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920649.147617:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951295360 00000100:00100000:0.0:1790920649.147627:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951295360 00000100:00100000:0.0:1790920649.147684:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1790920649.147692:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+7:2354:x1877915951295360:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790920649.147903:0:14963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790920649.147907:0:14963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790920647 00002000:00010000:0.0:1790920649.147910:0:14963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790920647 00002000:00010000:0.0:1790920649.147912:0:14963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790920649 -> 1790920647 00002000:00010000:0.0:1790920649.147915:0:14963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790920649.147961:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+8:2354:x1877915951295360:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 269us (462us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790920649.147969:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:3.0:1790920649.159287:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.159398:0:14964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951295488 00000100:00100000:2.0:1790920649.159408:0:14964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951295488 00000100:00100000:2.0:1790920649.159478:0:14964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1790920649.159489:0:14964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+8:2353:x1877915951295488:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790920649.159534:0:14964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159551:0:14964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920649.159555:0:14964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920649.159561:0:14964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159576:0:14964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159628:0:14964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159638:0:14964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159661:0:14964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159669:0:14964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3a4f3e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920649.159673:0:14964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159682:0:14964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159698:0:14964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.159705:0:14964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bed1a78/0x2a4915844546b743 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920649.159830:0:14964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5843125c-8114-4bc1-8486-e41e95eb2a70+8:2353:x1877915951295488:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 342us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920649.159837:0:14964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:1.0:1790920649.187823:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.191469:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951295744 00000100:00100000:2.0:1790920649.191486:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951295744 00000100:00100000:3.0:1790920649.192253:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:3.0:1790920649.192264:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+14:14458:x1877915951295744:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790920649.192350:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.192368:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.192380:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.193386:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.193408:0:16156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 15 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.193429:0:16156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.193497:0:16156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 15 pid: 16156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.193528:0:16156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 15 pid: 16156 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920649.193544:0:16156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16156:1877915972252928:192.168.204.34@tcp:104: 00000100:00100000:3.0:1790920649.193658:0:16156:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb051c6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790920649.197523:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920649.197628:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951295872 00000100:00100000:1.0:1790920649.197640:0:14267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951295872 00010000:00010000:1.0:1790920649.197683:0:14267:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 16 pid: 16156 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920649.197728:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1790920649.197783:0:14267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+16:2354:x1877915951295872:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790920649.197799:0:14267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790920649.197806:0:14267:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 16 pid: 16156 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.197821:0:14267:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 16 pid: 16156 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.197850:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:1.0:1790920649.197855:0:14267:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.197865:0:14267:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.197873:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.197893:0:14267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790920649.197943:0:14267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+16:2354:x1877915951295872:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 194us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920649.197950:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00010000:00010000:3.0:1790920649.198940:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb41e36a00/0x2a4915844546b720 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafbe expref: 15 pid: 16156 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920649.198962:0:16156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16156:1877915972252928:192.168.204.34@tcp:104: 00010000:00010000:3.0:1790920649.198984:0:16156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.198994:0:16156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.199001:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790920649.199187:0:16156:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1790920649.199353:0:16156:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1790920649.199401:0:16156:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1790920649.199576:0:16156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16156:1877915972253056:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790920649.202067:0:16156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920649.202120:0:16156:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb051c6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790920649.202216:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972253056 00000100:00100000:1.0:1790920649.202226:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972253056 00000100:00100000:1.0:1790920649.202273:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790920649.202283:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16156:x1877915972253056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790920649.202404:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16156:x1877915972253056:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920649.202434:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790920649.202726:0:16156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16156:1877915972253056:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790920649.203452:0:16156:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1790920649.203545:0:16156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16156:1877915972253184:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790920649.203604:0:16156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920649.203636:0:16156:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb08c48300 going to sleep for 11 seconds 00000100:00100000:1.0:1790920649.204433:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972253184 00000100:00100000:1.0:1790920649.204444:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972253184 00000100:00100000:1.0:1790920649.204511:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790920649.204522:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16156:x1877915972253184:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790920649.204739:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16156:x1877915972253184:12345-0@lo:1000:mdt00_003.0 Request processed in 218us (1134us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790920649.204774:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790920649.206062:0:16156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16156:1877915972253184:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790920649.206111:0:16156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.206122:0:16156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.206130:0:16156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.206137:0:16156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a52200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920649.206141:0:16156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.206149:0:16156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.206164:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:3.0:1790920649.206167:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790920649.206172:0:16156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.206179:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b751 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208185:0:16156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208282:0:16156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208310:0:16156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208317:0:16156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920649.208321:0:16156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208330:0:16156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208345:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920649.208348:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790920649.208357:0:16156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa2 expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208368:0:16156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa2 expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208379:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa2 expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.208441:0:16156:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443da00/0x2a4915844546b6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafa2 expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920649.209096:0:16156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16156:1877915972253312:192.168.204.34@tcp:105: 00000100:00100000:3.0:1790920649.209273:0:16156:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb08c48300 going to sleep for 11 seconds 00000100:00100000:0.0:1790920649.215116:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.215209:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951296000 00000100:00100000:2.0:1790920649.215220:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951296000 00000100:00100000:2.0:1790920649.215281:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:2.0:1790920649.215292:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb067d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+19:14457:x1877915951296000:12345-192.168.204.34@tcp:49:dd.0 00000100:00100000:2.0:1790920649.215452:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb067d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+19:14457:x1877915951296000:12345-192.168.204.34@tcp:49:dd.0 Request processed in 161us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920649.215460:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:3.0:1790920649.221042:0:16156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16156:1877915972253312:192.168.204.34@tcp:105: 00010000:00010000:3.0:1790920649.221096:0:16156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221107:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3443c200/0x2a4915844546b6b0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221143:0:16156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221157:0:16156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221169:0:16156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221181:0:16156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221187:0:16156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221207:0:16156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221213:0:16156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a52200 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920649.221217:0:16156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221225:0:16156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221238:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920649.221248:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790920649.221253:0:16156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221259:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a52200/0x2a4915844546b758 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221269:0:16156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221275:0:16156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221281:0:16156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221286:0:16156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a53c00 already unused, calling callback (ffffffffc20a64f0) 00010000:00010000:3.0:1790920649.221289:0:16156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221296:0:16156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221304:0:16156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88eb0856fc00) 00010000:00010000:3.0:1790920649.221306:0:16156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790920649.221309:0:16156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.221315:0:16156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb07a53c00/0x2a4915844546b74a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920649.222283:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+18:14458:x1877915951295744:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 30013us (34461us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1790920649.222308:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000020:00080000:3.0:1790920649.222314:0:16156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790920649.228095:0:14311:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790920649.228104:0:14311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790920649.228134:0:14311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790920649.228141:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790920649.232653:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.233273:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951296256 00000100:00100000:2.0:1790920649.233287:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951296256 00000100:00100000:2.0:1790920649.233350:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:2.0:1790920649.233361:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+18:14458:x1877915951296256:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790920649.240636:0:14283:0:(mdd_object.c:4178:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790920649.240737:0:14283:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790920649.241397:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.241425:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.241438:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.241447:0:14283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.242019:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.242032:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.242060:0:14283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790920649.242180:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+20:14458:x1877915951296256:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 8816us (9535us total) trans 8589934622 rc 0/0 00010000:00010000:0.0:1790920649.242426:0:14269:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790920649.242435:0:14269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.242442:0:14269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3a4f3e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920649.242446:0:14269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.242465:0:14269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.242491:0:14269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88eb0856f000) 00010000:00010000:0.0:1790920649.242494:0:14269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790920649.242499:0:14269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.242504:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88eb3a4f3e00/0x2a4915844546b75f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.242520:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920649.242522:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790920649.242524:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920649.243968:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000020:00080000:2.0:1790920649.243978:0:14283:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790920649.449734:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790920649.522470:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920649.522517:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920649.522586:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920649.522641:0:14971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951296384 00000100:00100000:1.0:1790920649.522651:0:14971:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951296384 00000100:00100000:1.0:1790920649.522709:0:14971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951296512 00000100:00100000:1.0:1790920649.522712:0:14971:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951296512 00000100:00100000:1.0:1790920649.522722:0:14971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951296640 00000100:00100000:1.0:1790920649.522724:0:14971:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951296640 00000100:00100000:1.0:1790920649.522740:0:14971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1790920649.522777:0:14971:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+10:2353:x1877915951296384:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:1.0:1790920649.522814:0:14971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.522834:0:14971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 10 pid: 14964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.522844:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920649.522848:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920649.522869:0:14971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.522911:0:14971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 10 pid: 14964 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.522926:0:14971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 10 pid: 14964 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920649.522953:0:14971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:14971:1877915972253440:192.168.204.34@tcp:104: 00000100:00100000:1.0:1790920649.523070:0:14971:0:(client.c:2716:ptlrpc_set_wait()) set ffff88eb3f681e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790920649.527669:0:14971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb33f70380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:14971:1877915972253440:192.168.204.34@tcp:104: 00010000:00010000:2.0:1790920649.527705:0:14971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920649.530536:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1790920649.530717:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951296768 00000100:00100000:0.0:1790920649.530728:0:14265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951296768 00010000:00010000:0.0:1790920649.530803:0:14265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 11 pid: 14964 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920649.530845:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:0.0:1790920649.530855:0:14265:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+11:2355:x1877915951296768:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790920649.530870:0:14265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790920649.530891:0:14265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 11 pid: 14964 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.530904:0:14265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 11 pid: 14964 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.530929:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055189be6/0x2a4915844546b735 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0xadd38bcb46edafcc expref: 11 pid: 14964 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.530962:0:14265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920649.530966:0:14265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920649.530972:0:14265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.530983:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.531025:0:14265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790920649.531095:0:14265:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+10:2355:x1877915951296768:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 240us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920649.531102:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00010000:00010000:2.0:1790920649.531309:0:14971:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.531319:0:14971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920649.618058:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1790920649.618081:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1790920649.618088:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1790920649.618222:0:14971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1790920649.618227:0:14971:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1790920647 -> 1790920649 00002000:00010000:0.0:1790920649.618229:0:14971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1790920649.618244:0:14971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618259:0:14971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618267:0:14971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618274:0:14971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443dc00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920649.618278:0:14971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618302:0:14971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618324:0:14971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618331:0:14971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e297fee/0x2a4915844546b766 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920649.618476:0:14971:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+7:2353:x1877915951296384:12345-192.168.204.34@tcp:4:dd.0 Request processed in 95722us (96013us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790920649.618491:0:14971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1790920649.618522:0:14971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:0.0:1790920649.618547:0:14971:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2355:x1877915951296512:12345-192.168.204.34@tcp:4:dd.0 00002000:00010000:0.0:1790920649.618726:0:14971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6abf47c9, atime: 0x6abf47c7, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1790920649.618734:0:14971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618797:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:0.0:1790920649.618802:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920649.618809:0:14971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.618823:0:14971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790920649.706467:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1790920649.706636:0:14971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1790920649.706641:0:14971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1790920649.706656:0:14971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.706670:0:14971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.706680:0:14971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.706687:0:14971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52000 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920649.706691:0:14971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.706700:0:14971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.706925:0:14971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.706933:0:14971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335af7a2/0x2a4915844546b76d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920649.707082:0:14971:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2355:x1877915951296512:12345-192.168.204.34@tcp:4:dd.0 Request processed in 88535us (184558us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790920649.707178:0:14971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:0.0:1790920649.707345:0:14971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:0.0:1790920649.707358:0:14971:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2353:x1877915951296640:12345-192.168.204.34@tcp:4:dd.0 00002000:00010000:0.0:1790920649.707401:0:14971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6abf47c9, atime: 0x6abf47c7, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1790920649.707407:0:14971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.707418:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:0.0:1790920649.707422:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920649.707428:0:14971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.707441:0:14971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790920649.783518:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1790920649.783605:0:14971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1790920649.783609:0:14971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1790920649.783837:0:14971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.783851:0:14971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.783860:0:14971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.783884:0:14971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52800 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920649.783888:0:14971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.783898:0:14971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.783918:0:14971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.783926:0:14971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dd788ee/0x2a4915844546b774 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920649.784140:0:14971:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2353:x1877915951296640:12345-192.168.204.34@tcp:4:dd.0 Request processed in 76780us (261547us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790920649.784151:0:14971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:3.0:1790920649.793441:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920649.793487:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.793686:0:14969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951296896 00000100:00100000:2.0:1790920649.793697:0:14969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951296896 00000100:00100000:2.0:1790920649.793776:0:14969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297024 00000100:00100000:2.0:1790920649.793779:0:14969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297024 00000100:00100000:2.0:1790920649.793800:0:14969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:2.0:1790920649.793810:0:14969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+6:2355:x1877915951296896:12345-192.168.204.34@tcp:4:dd.0 00002000:00010000:2.0:1790920649.793860:0:14969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abf47c9, atime: 0x6abf47c7, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1790920649.793870:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.793887:0:14969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1790920649.793891:0:14969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790920649.793898:0:14969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.793927:0:14969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790920649.797187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1790920649.797400:0:14971:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1790920649.797413:0:14971:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1790920649.798785:0:14971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297152 00000100:00100000:2.0:1790920649.798797:0:14971:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297152 00000100:00100000:0.0:1790920649.799064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920649.799502:0:14971:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1790920649.799515:0:14971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297408 00000100:00100000:2.0:1790920649.799522:0:14971:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297408 00000100:00100000:1.0:1790920649.799633:0:16517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:1.0:1790920649.799643:0:16517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+9:2355:x1877915951297024:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:1.0:1790920649.799681:0:16517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.799700:0:16517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920649.799704:0:16517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920649.799717:0:16517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.799735:0:16517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920649.805505:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920649.805742:0:14971:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1790920649.805830:0:14971:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1790920649.809989:0:14971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297280 00000100:00100000:3.0:1790920649.810004:0:14971:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297280 00000100:00100000:3.0:1790920649.812720:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1790920649.812740:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3fe10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5843125c-8114-4bc1-8486-e41e95eb2a70+11:2355:x1877915951297152:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:3.0:1790920649.813362:0:16518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.813385:0:16518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920649.813390:0:16518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790920649.813398:0:16518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790920649.813414:0:16518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790920649.875484:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1790920649.875741:0:14969:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:0.0:1790920649.875760:0:14969:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1790920649 -> 1790920650 00002000:00010000:0.0:1790920649.875763:0:14969:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790920650 00002000:00010000:0.0:1790920649.875765:0:14969:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1790920649.875779:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.875791:0:14969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.875819:0:14969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.875827:0:14969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3a4f2c00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:0.0:1790920649.875831:0:14969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.875840:0:14969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.875862:0:14969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.875869:0:14969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a13dcb3b/0x2a4915844546b77b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790920649.875954:0:14969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+15:2355:x1877915951296896:12345-192.168.204.34@tcp:4:dd.0 Request processed in 82139us (82517us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1790920649.875965:0:14969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1790920649.875996:0:14969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1790920649.876008:0:14969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3af10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+14:2354:x1877915951297408:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:0.0:1790920649.876039:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.876065:0:14969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790920649.876078:0:14969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790920649.876085:0:14969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790920649.876097:0:14969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790920649.962040:0:16517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1790920649.962260:0:16517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1790920649.962276:0:16517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962289:0:16517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962298:0:16517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962306:0:16517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443c600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920649.962312:0:16517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962321:0:16517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962343:0:16517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962351:0:16517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002759fc42/0x2a4915844546b782 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920649.962483:0:16517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+16:2355:x1877915951297024:12345-192.168.204.34@tcp:4:dd.0 Request processed in 162834us (168988us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1790920649.962493:0:16517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000001:00080000:2.0:1790920649.962511:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000100:00100000:1.0:1790920649.962528:0:16517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1790920649.962541:0:16517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+11:2354:x1877915951297280:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:1.0:1790920649.962584:0:16517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962596:0:16517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920649.962601:0:16517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790920649.962607:0:16517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920649.962689:0:16517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.966782:0:16518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.966817:0:16518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.966828:0:16518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.966836:0:16518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb07a52600 already unused, calling callback (ffffffffc1634900) 00010000:00010000:2.0:1790920649.966841:0:16518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.966850:0:16518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.966898:0:16518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790920649.966907:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e228a4c/0x2a4915844546b789 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790920649.974375:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3fe10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5843125c-8114-4bc1-8486-e41e95eb2a70+11:2355:x1877915951297152:12345-192.168.204.34@tcp:4:dd.0 Request processed in 161625us (177188us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790920649.974391:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000001:00080000:3.0:1790920650.035216:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1790920650.035919:0:14969:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1790920650.035938:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.035951:0:14969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.035959:0:14969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.035980:0:14969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3ae52e00 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920650.035985:0:14969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.035993:0:14969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.037171:0:14969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.037202:0:14969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b66324f/0x2a4915844546b790 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920650.037332:0:14969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3af10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5843125c-8114-4bc1-8486-e41e95eb2a70+9:2354:x1877915951297408:12345-192.168.204.34@tcp:4:dd.0 Request processed in 161319us (238274us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1790920650.037345:0:14969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000001:00080000:3.0:1790920650.073350:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1790920650.073476:0:16517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1790920650.073494:0:16517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.073507:0:16517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.073526:0:16517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.073555:0:16517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88eb3443d200 already unused, calling callback (ffffffffc1634900) 00010000:00010000:1.0:1790920650.073560:0:16517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.073581:0:16517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.073613:0:16517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790920650.073622:0:16517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a4c4a9/0x2a4915844546b797 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790920650.073730:0:16517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2354:x1877915951297280:12345-192.168.204.34@tcp:4:dd.0 Request processed in 111188us (268229us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1790920650.073741:0:16517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00010000:00010000:0.0:1790920650.479869:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790920650.896461:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920650.896516:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920650.896561:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920650.896600:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920650.896613:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297536 00000100:00100000:3.0:1790920650.896624:0:14275:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297536 00000100:00100000:2.0:1790920650.896629:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1790920650.896657:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920650.896685:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:2.0:1790920650.896692:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1790920650.896701:0:14275:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+13:2355:x1877915951297536:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920650.896723:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297792 00000100:00100000:2.0:1790920650.896730:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297792 00000100:00100000:2.0:1790920650.896802:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951298304 00000100:00100000:2.0:1790920650.896806:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951298304 00000100:00100000:3.0:1790920650.896819:0:14275:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:574fd940-44bf-4bed-b114-917b4fd5a50a+13:2355:x1877915951297536:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920650.896823:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297920 00000100:00100000:2.0:1790920650.896827:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297920 00000100:00100000:3.0:1790920650.896831:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:2.0:1790920650.896844:0:16162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951298176 00000100:00100000:2.0:1790920650.896849:0:16162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951298176 00000100:00100000:2.0:1790920650.896870:0:16162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1790920650.896878:0:16162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2355:x1877915951297792:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920650.896910:0:16162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2355:x1877915951297792:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 33us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920650.896925:0:16162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1790920650.896940:0:16162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1790920650.896947:0:16162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2355:x1877915951298304:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1790920650.897026:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951298048 00000100:00100000:1.0:1790920650.897030:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951298048 00000100:00100000:1.0:1790920650.897058:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915951297664 00000100:00100000:1.0:1790920650.897061:0:14280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915951297664 00000100:00100000:1.0:1790920650.897143:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:1.0:1790920650.897152:0:14280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2355:x1877915951298048:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1790920650.897204:0:16162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2355:x1877915951298304:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920650.897212:0:16162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1790920650.897225:0:16162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:2.0:1790920650.897232:0:16162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2355:x1877915951297920:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1790920650.897352:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:0.0:1790920650.897362:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2355:x1877915951298176:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920650.902952:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:3.0:1790920650.902974:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+20:2355:x1877915951297664:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1790920650.903066:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb33ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+20:2355:x1877915951297664:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 102us (6438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920650.903074:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00080000:3.0:1790920650.903145:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790920650.903152:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790920650.903155:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790920650.913699:0:14280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb34253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+6:2355:x1877915951298048:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 16534us (17123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790920650.913714:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:0.0:1790920650.919121:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b496f1b-f428-4353-85dd-ead3c534fea1+5:2355:x1877915951298176:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 21747us (22419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920650.919138:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:2.0:1790920650.924738:0:16162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb05629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5843125c-8114-4bc1-8486-e41e95eb2a70+5:2355:x1877915951297920:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 27491us (28067us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920650.924770:0:16162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00010000:00010000:2.0:1790920651.498444:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790920652.214294:0:16556:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1790920652.398371:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972253696:0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.398448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920652.398495:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972254208:0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.398516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920652.398553:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790920652.398558:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972253568:0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.398582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920652.398601:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972254080:0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.398618:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790920652.398644:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972253696 00000100:00100000:3.0:1790920652.398651:0:14965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972253696 00000100:00100000:3.0:1790920652.398704:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920652.398713:0:14965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972253696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.398775:0:14965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877915972253696:12345-0@lo:400:kworker.0 Request processed in 63us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920652.398790:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790920652.398812:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972254208 00000100:00100000:3.0:1790920652.398815:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972254208 00000100:00100000:3.0:1790920652.398835:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972254080 00000100:00100000:3.0:1790920652.398837:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972254080 00000100:00100000:3.0:1790920652.398853:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790920652.398859:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972254208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.398886:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877915972254208:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920652.398892:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790920652.398902:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790920652.398907:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972254080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.398930:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877915972254080:12345-0@lo:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920652.398936:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790920652.398952:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972253568 00000100:00100000:3.0:1790920652.398955:0:14273:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972253568 00000100:00100000:3.0:1790920652.398977:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790920652.398982:0:14273:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+19:3307:x1877915972253568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.399010:0:14273:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b6dbfc26-a70a-426c-a856-613d861b9981+19:3307:x1877915972253568:12345-0@lo:400:kworker.0 Request processed in 28us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790920652.399015:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1790920652.399039:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790920652.399043:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790920652.399066:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b6dbfc26-a70a-426c-a856-613d861b9981:3307:1877915972253568:0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.399079:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1877915972254080:0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.399098:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1877915972253696:0@lo:400:kworker.0 00000100:00100000:3.0:1790920652.399107:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1877915972254208:0@lo:400:kworker.0 00000100:00100000:2.0:1790920652.400335:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972253824:0@lo:400:kworker.0 00000100:00100000:2.0:1790920652.400387:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920652.400419:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3a92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972254336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790920652.400440:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920652.400459:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790920652.400465:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb3fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972253952:0@lo:400:kworker.0 00000100:00100000:2.0:1790920652.400488:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920652.400540:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972254336 00000100:00100000:2.0:1790920652.400547:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972254336 00000100:00100000:2.0:1790920652.400595:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920652.400604:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972254336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790920652.400635:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790920652.400686:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3f655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972254336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920652.400692:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790920652.400713:0:16156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972253952 00000100:00100000:2.0:1790920652.400717:0:16156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972253952 00000100:00100000:2.0:1790920652.400742:0:16156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790920652.400773:0:16156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb10a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972253952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790920652.400804:0:16156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb10a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877915972253952:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920652.400811:0:16156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790920652.400827:0:14276:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790920652.400857:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877915972253952:0@lo:400:kworker.0 00000100:00100000:2.0:1790920652.400867:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1790920652.400871:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88eb3fe11180, transno 8589934595 00000004:00080000:2.0:1790920652.400883:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1790920652.400910:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3a92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972254336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790920652.401374:0:14963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972253824 00000100:00100000:0.0:1790920652.401381:0:14963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972253824 00000100:00100000:0.0:1790920652.401413:0:14963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790920652.401420:0:14963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972253824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790920652.401463:0:14963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb3a92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972253824:12345-0@lo:400:kworker.0 Request processed in 43us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790920652.401468:0:14963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790920652.401499:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb3fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972253824:0@lo:400:kworker.0 00010000:00010000:0.0:1790920652.521500:0:14269:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790920653.546201:0:14268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790920653.929992:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790920653.930016:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972254464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790920653.930084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790920653.930277:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877915972254464 00000100:00100000:2.0:1790920653.930286:0:14967:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877915972254464 00000100:00100000:2.0:1790920653.930344:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790920653.930354:0:14967:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88eb41c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972254464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790920653.930391:0:14967:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790920653.930442:0:14967:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88eb41c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877915972254464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790920653.930449:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790920653.930555:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88eb10a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1877915972254464:0@lo:13:osp-pre-0-0.0 Debug log: 29772 lines, 29772 kept, 0 dropped, 0 bad.